[ 547.488582] env[69232]: INFO neutron.common.config [-] Logging enabled! [ 547.489126] env[69232]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 0.0.1.dev78 [ 547.489126] env[69232]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=69232) setup_logging /opt/stack/neutron/neutron/common/config.py:124}} [ 547.489373] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ... [ 547.489475] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed. [ 547.490363] env[69232]: WARNING oslo_policy.policy [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 547.490583] env[69232]: WARNING oslo_policy.policy [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 547.492117] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] VMware NSXv3 Agent initialized successfully. [ 547.492479] env[69232]: DEBUG oslo_concurrency.lockutils [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] Acquiring lock "singleton_lock" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 547.492669] env[69232]: DEBUG oslo_concurrency.lockutils [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] Acquired lock "singleton_lock" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 547.492822] env[69232]: DEBUG oslo_concurrency.lockutils [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] Releasing lock "singleton_lock" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 547.493244] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] Full set of CONF: {{(pid=69232) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/eventlet/service.py:357}} [ 547.493370] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] ******************************************************************************** {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}} [ 547.493483] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] Configuration options gathered from: {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}} [ 547.493734] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini', '--config-file', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}} [ 547.493908] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}} [ 547.494030] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] ================================================================================ {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}} [ 547.494208] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] agent_down_time = 75 {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.494356] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] allow_automatic_dhcp_failover = True {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.494501] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] allow_bulk = True {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.494656] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] api_extensions_path = {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.494804] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] api_paste_config = api-paste.ini {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.494952] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] auth_strategy = keystone {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.495078] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] backdoor_port = None {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.495190] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] backdoor_socket = None {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.495335] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] backlog = 4096 {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.495480] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] base_mac = fa:16:3e:00:00:00 {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.495669] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] bind_host = 0.0.0.0 {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.495827] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] bind_port = 9696 {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.495978] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] client_socket_timeout = 900 {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.496162] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] config_dir = [] {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.496285] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.496432] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] config_source = [] {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.496580] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] control_exchange = neutron {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.496728] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] core_plugin = ml2 {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.496876] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] debug = True {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.497032] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] default_availability_zones = [] {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.497251] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.497399] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] dhcp_agent_notification = True {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.497543] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] dhcp_agents_per_network = 1 {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.497713] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] dhcp_lease_duration = 86400 {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.497864] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] dhcp_load_type = networks {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.498012] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] dns_domain = openstacklocal {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.498164] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.498301] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] enable_default_route_bfd = False {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.498443] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] enable_default_route_ecmp = False {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.498581] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] enable_dvr = True {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.498742] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] enable_new_agents = True {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.498894] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] enable_services_on_agents_with_admin_state_down = False {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.499049] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] enable_signals = True {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.499184] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] enable_traditional_dhcp = True {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.499319] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] external_dns_driver = None {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.499457] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] filter_validation = True {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.499633] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] global_physnet_mtu = 8950 {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.499746] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] graceful_shutdown_timeout = 60 {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.499930] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] host = cpu-1 {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.500088] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] host_dvr_for_dhcp = True {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.500232] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] http_retries = 3 {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.500375] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] instance_format = [instance: %(uuid)s] {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.500517] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.500660] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] ipam_driver = internal {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.500823] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] ipv6_pd_enabled = False {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.501037] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] l3_ha = False {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.501184] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.501331] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] l3_ha_network_physical_name = {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.501477] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] l3_ha_network_type = {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.501623] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] log_color = False {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.501798] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] log_config_append = None {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.501961] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.502116] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] log_dir = None {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.502257] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] log_file = None {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.502372] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] log_options = True {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.502514] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] log_rotate_interval = 1 {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.502661] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] log_rotate_interval_type = days {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.502803] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] log_rotation_type = none {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.502914] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.503031] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.503180] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.503321] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.503429] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.503570] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] max_dns_nameservers = 5 {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.503711] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] max_header_line = 16384 {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.503877] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] max_l3_agents_per_router = 3 {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.504041] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] max_logfile_count = 30 {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.504185] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] max_logfile_size_mb = 200 {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.504321] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] max_subnet_host_routes = 20 {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.504465] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] my_ip = 10.180.1.21 {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.504606] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] my_ipv6 = ::1 {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.504743] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] network_auto_schedule = True {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.504880] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] network_link_prefix = None {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.505032] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.505180] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] notify_nova_on_port_data_changes = True {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.505321] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] notify_nova_on_port_status_changes = True {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.505466] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] pagination_max_limit = -1 {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.505624] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] publish_errors = False {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.505772] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] rate_limit_burst = 0 {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.505919] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] rate_limit_except_level = CRITICAL {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.506069] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] rate_limit_interval = 0 {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.506208] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] retry_until_window = 30 {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.506345] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] router_distributed = False {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.506480] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] rpc_resources_processing_step = 20 {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.506614] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] rpc_response_max_timeout = 600 {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.506749] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] rpc_response_timeout = 60 {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.506909] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] send_events_interval = 2 {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.507088] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] service_plugins = ['router'] {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.507242] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] setproctitle = on {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.507379] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] shell_completion = None {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.507524] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] state_path = /opt/stack/data/neutron {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.507670] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] syslog_log_facility = LOG_USER {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.507832] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] tcp_keepidle = 600 {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.507978] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] transport_url = **** {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.508133] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] use_journal = False {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.508271] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] use_json = False {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.508411] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] use_ssl = False {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.508546] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] use_stderr = False {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.508692] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] use_syslog = False {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.508848] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] vlan_qinq = False {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.508993] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] vlan_transparent = False {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.509144] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] watch_log_file = False {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.509285] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] wsgi_default_pool_size = 100 {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.509422] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] wsgi_keep_alive = True {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.509567] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.509707] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] wsgi_server_debug = False {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.509868] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] oslo_concurrency.disable_process_locking = False {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.510056] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.510206] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.510353] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.510501] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] oslo_messaging_metrics.metrics_process_name = {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.510648] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.510793] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.510950] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] profiler.connection_string = messaging:// {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.511110] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] profiler.enabled = False {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.511262] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] profiler.es_doc_type = notification {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.511404] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] profiler.es_scroll_size = 10000 {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.511548] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] profiler.es_scroll_time = 2m {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.511688] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] profiler.filter_error_trace = False {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.511831] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] profiler.hmac_keys = **** {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.511975] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] profiler.sentinel_service_name = mymaster {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.512134] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] profiler.socket_timeout = 0.1 {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.512271] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] profiler.trace_requests = False {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.512425] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] profiler.trace_sqlalchemy = False {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.512638] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] profiler_jaeger.process_tags = {} {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.512788] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] profiler_jaeger.service_name_prefix = None {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.512991] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] profiler_otlp.service_name_prefix = None {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.513101] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] oslo_policy.enforce_new_defaults = True {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.513376] env[69232]: WARNING oslo_config.cfg [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. [ 547.513529] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] oslo_policy.enforce_scope = True {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.513680] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] oslo_policy.policy_default_rule = default {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.513840] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.513985] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.514147] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.514285] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.514420] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.514556] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.514694] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.514840] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] oslo_policy.remote_timeout = 60.0 {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.514990] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.515157] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] agent.extensions = [] {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.515305] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.515472] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] service_providers.service_provider = [] {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.515638] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] QUOTAS.default_quota = -1 {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.515787] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.515930] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] QUOTAS.quota_floatingip = 50 {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.516082] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] QUOTAS.quota_network = 100 {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.516224] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] QUOTAS.quota_port = 500 {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.516362] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] QUOTAS.quota_rbac_policy = 10 {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.516501] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] QUOTAS.quota_router = 10 {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.516638] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] QUOTAS.quota_security_group = 10 {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.516775] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] QUOTAS.quota_security_group_rule = 100 {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.516917] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] QUOTAS.quota_subnet = 100 {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.517063] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] QUOTAS.track_quota_usage = True {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.517218] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.517358] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] privsep.group = None {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.517495] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] privsep.helper_command = None {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.517636] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] privsep.logger_name = oslo_privsep.daemon {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.517799] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] privsep.thread_pool_size = 8 {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.517942] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] privsep.user = None {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.518101] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] privsep_dhcp_release.capabilities = [21, 12] {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.518240] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] privsep_dhcp_release.group = None {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.518375] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] privsep_dhcp_release.helper_command = None {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.518569] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.518786] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] privsep_dhcp_release.thread_pool_size = 8 {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.518945] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] privsep_dhcp_release.user = None {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.519111] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.519252] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] privsep_ovs_vsctl.group = None {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.519388] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] privsep_ovs_vsctl.helper_command = None {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.519535] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.519676] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] privsep_ovs_vsctl.thread_pool_size = 8 {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.519813] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] privsep_ovs_vsctl.user = None {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.519958] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] privsep_namespace.capabilities = [21] {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.520108] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] privsep_namespace.group = None {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.520243] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] privsep_namespace.helper_command = None {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.520385] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.520524] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] privsep_namespace.thread_pool_size = 8 {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.520660] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] privsep_namespace.user = None {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.520806] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] privsep_conntrack.capabilities = [12] {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.520942] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] privsep_conntrack.group = None {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.521099] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] privsep_conntrack.helper_command = None {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.521240] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.521383] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] privsep_conntrack.thread_pool_size = 8 {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.521539] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] privsep_conntrack.user = None {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.521700] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] privsep_link.capabilities = [12, 21] {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.521841] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] privsep_link.group = None {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.521982] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] privsep_link.helper_command = None {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.522138] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] privsep_link.logger_name = oslo_privsep.daemon {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.522278] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] privsep_link.thread_pool_size = 8 {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.522414] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] privsep_link.user = None {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.522570] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] AGENT.agent_id = nsxm-l-01a.corp.local {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.522721] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] AGENT.agent_prometheus_exporter_port = 8000 {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.522866] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] AGENT.continue_on_failed_promotions = False {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.523062] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] AGENT.dscp = None {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.523160] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] AGENT.dscp_inherit = False {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.523305] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] AGENT.force_mp_to_policy = True {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.523451] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] AGENT.locking_coordinator_url = None {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.523589] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] AGENT.log_agent_heartbeats = False {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.523730] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] AGENT.logging_expire = 1 {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.523880] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] AGENT.logging_url = unix:///var/run/redis/socket/redis.sock {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.524031] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] AGENT.max_sg_tags_per_segment_port = 27 {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.524184] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] AGENT.polling_interval = 240 {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.524332] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] AGENT.ports_tag_number_decrease_workaround = True {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.524480] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] AGENT.quitting_rpc_timeout = 120 {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.524654] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] AGENT.report_interval = 30.0 {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.524805] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] AGENT.root_helper = sudo /opt/stack/data/venv/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.524954] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] AGENT.root_helper_daemon = sudo /opt/stack/data/venv/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.525114] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] AGENT.rpc_max_records_per_query = 1000 {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.525259] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] AGENT.sync_skew = 60 {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.525405] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] AGENT.synchronization_queue_size = 20 {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.525545] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] AGENT.use_helper_for_ns_read = True {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.525696] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] SECURITYGROUP.enable_ipset = True {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.525852] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] SECURITYGROUP.enable_security_group = True {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.526000] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] SECURITYGROUP.firewall_driver = nsxv3 {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.526164] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] SECURITYGROUP.permitted_ethertypes = [] {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.526313] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] experimental.ipv6_pd_enabled = False {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.526480] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] ml2.extension_drivers = ['port_security'] {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.526623] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] ml2.external_network_type = None {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.526781] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] ml2.mechanism_drivers = ['nsxv3', 'openvswitch', 'logger'] {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.526933] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] ml2.overlay_ip_version = 4 {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.527095] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] ml2.path_mtu = 8950 {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.527397] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] ml2.physical_network_mtus = {} {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.527397] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] ml2.tenant_network_types = ['vlan'] {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.527541] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] ml2.tunnelled_network_rp_name = rp_tunnelled {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.527747] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] ml2.type_drivers = ['vlan'] {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.527906] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] AGENT_CLI.neutron_port_id = [] {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.528066] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] AGENT_CLI.neutron_qos_policy_id = [] {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.528213] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] AGENT_CLI.neutron_security_group_id = [] {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.528369] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] NSXV3.nsxv3_concurrent_requests = 40 {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.528523] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] NSXV3.nsxv3_connection_retry_count = 2 {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.528687] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] NSXV3.nsxv3_connection_retry_sleep = 2 {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.528866] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] NSXV3.nsxv3_default_policy_infrastructure_rules = True {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.529016] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] NSXV3.nsxv3_dfw_connectivity_strategy = NONE {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.529241] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] NSXV3.nsxv3_ip_discovery_switching_profile = nsx-default-ip-discovery-vlan-profile {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.529571] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] NSXV3.nsxv3_login_hostname = nsxt.osci.c.eu-de-1.cloud.sap {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.529827] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] NSXV3.nsxv3_login_password = **** {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.530104] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] NSXV3.nsxv3_login_port = 443 {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.530322] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] NSXV3.nsxv3_login_user = admin {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.530490] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] NSXV3.nsxv3_managed_hosts = [] {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.530648] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] NSXV3.nsxv3_max_records_per_query = 200 {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.530860] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] NSXV3.nsxv3_operation_retry_count = 3 {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.531046] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] NSXV3.nsxv3_operation_retry_sleep = 5 {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.531210] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] NSXV3.nsxv3_realization_timeout = 300 {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.531374] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] NSXV3.nsxv3_remove_orphan_ports_after = 2.0 {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.531525] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] NSXV3.nsxv3_request_timeout = 60 {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.531675] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] NSXV3.nsxv3_requests_per_second = 80 {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.531823] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] NSXV3.nsxv3_requests_per_second_timeout = 7 {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.531974] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] NSXV3.nsxv3_spoof_guard_switching_profile = nsx-default-spoof-guard-vif-profile {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.532144] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] NSXV3.nsxv3_suppress_ssl_warnings = True {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.532290] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] NSXV3.nsxv3_transport_zone_id_cache_time = 86400 {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.532439] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] NSXV3.nsxv3_transport_zone_name = nsx-vlan-transportzone {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.532647] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] vsphere.vsphere_login_hostname = vc-l-01a.corp.local {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.532802] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] vsphere.vsphere_login_password = VMware1! {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.532954] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] vsphere.vsphere_login_username = administrator@vsphere.local {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.533113] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] vsphere.vsphere_suppress_ssl_wornings = True {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.533288] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] nova.auth_section = None {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.533447] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] nova.auth_type = password {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.533600] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.533737] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] nova.certfile = None {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.533880] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] nova.collect_timing = False {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.534040] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] nova.endpoint_type = public {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.534188] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] nova.insecure = False {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.534324] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] nova.keyfile = None {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.534472] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] nova.region_name = RegionOne {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.534616] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] nova.split_loggers = False {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.534750] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] nova.timeout = None {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.534898] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] placement.auth_section = None {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.535057] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] placement.auth_type = password {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.535206] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] placement.cafile = /opt/stack/data/ca-bundle.pem {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.535344] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] placement.certfile = None {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.535485] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] placement.collect_timing = False {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.535630] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] placement.endpoint_type = public {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.535771] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] placement.insecure = False {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.535908] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] placement.keyfile = None {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.536049] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] placement.region_name = None {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.536207] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] placement.split_loggers = False {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.536354] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] placement.timeout = None {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.536509] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] ironic.auth_section = None {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.536640] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] ironic.auth_type = None {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.536777] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] ironic.cafile = None {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.536913] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] ironic.certfile = None {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.537062] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] ironic.collect_timing = False {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.537201] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] ironic.connect_retries = None {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.537337] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] ironic.connect_retry_delay = None {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.537479] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] ironic.enable_notifications = False {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.537611] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] ironic.endpoint_override = None {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.537775] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] ironic.insecure = False {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.537921] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] ironic.interface = None {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.538070] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] ironic.keyfile = None {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.538208] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] ironic.max_version = None {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.538343] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] ironic.min_version = None {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.538478] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] ironic.region_name = None {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.538614] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] ironic.retriable_status_codes = None {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.538759] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] ironic.service_name = None {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.538898] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] ironic.service_type = None {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.539192] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] ironic.split_loggers = False {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.539192] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] ironic.status_code_retries = None {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.539316] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] ironic.status_code_retry_delay = None {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.539448] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] ironic.timeout = None {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.539785] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] ironic.valid_interfaces = None {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.539785] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] ironic.version = None {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.539911] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] cli_script.dry_run = False {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.540038] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.540184] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.540325] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.540552] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.540659] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.540798] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.540897] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.540993] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.541201] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.541290] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] oslo_messaging_rabbit.hostname = devstack {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.541429] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.541577] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.541748] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.541880] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.541999] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.542156] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] oslo_messaging_rabbit.processname = neutron-nsxv3-agent {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.542298] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.542434] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.542579] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.542719] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.542859] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.543019] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.543166] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.543363] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.543463] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.543587] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.543728] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.543872] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.544027] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.544164] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.544306] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] oslo_messaging_rabbit.ssl = False {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.544453] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.544597] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.544738] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.544884] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.545037] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] oslo_messaging_rabbit.ssl_version = {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.545180] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.545334] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] oslo_messaging_notifications.driver = [] {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.545478] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] oslo_messaging_notifications.retry = -1 {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.545658] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.545813] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] oslo_messaging_notifications.transport_url = **** {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.545931] env[69232]: DEBUG oslo_service.backend.eventlet.service [None req-a437ba9e-0f28-46c9-a01d-130ce8a281cc None None] ******************************************************************************** {{(pid=69232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}} [ 547.546948] env[69232]: DEBUG neutron.agent.securitygroups_rpc [None req-94066da2-e1f6-4276-9635-375c603f4834 None None] Init firewall settings (driver=nsxv3) {{(pid=69232) init_firewall /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:137}} [ 547.548367] env[69232]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.extensions.firewall [None req-94066da2-e1f6-4276-9635-375c603f4834 None None] Initializing NSXv3SecurityGroupsDriver dummy driver. {{(pid=69232) __init__ /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/extensions/firewall.py:16}} [ 547.548614] env[69232]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-94066da2-e1f6-4276-9635-375c603f4834 None None] RPC agent_id: nsxm-l-01a.corp.local [ 547.550866] env[69232]: DEBUG dogpile.cache.region [None req-94066da2-e1f6-4276-9635-375c603f4834 None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 547.550987] env[69232]: DEBUG dogpile.lock [None req-94066da2-e1f6-4276-9635-375c603f4834 None None] NeedRegenerationException {{(pid=69232) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 547.551097] env[69232]: DEBUG dogpile.lock [None req-94066da2-e1f6-4276-9635-375c603f4834 None None] no value, waiting for create lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 547.551191] env[69232]: DEBUG dogpile.lock [None req-94066da2-e1f6-4276-9635-375c603f4834 None None] value creation lock acquired {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 547.551286] env[69232]: DEBUG dogpile.cache.region [None req-94066da2-e1f6-4276-9635-375c603f4834 None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 547.551376] env[69232]: DEBUG dogpile.lock [None req-94066da2-e1f6-4276-9635-375c603f4834 None None] Calling creation function for not-yet-present value {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 547.551500] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94066da2-e1f6-4276-9635-375c603f4834 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 547.584121] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-94066da2-e1f6-4276-9635-375c603f4834 None None] Session token - acquiring [ 547.585646] env[69232]: DEBUG networking_nsxv3.common.locking [None req-94066da2-e1f6-4276-9635-375c603f4834 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [, , , , , , , , , , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 547.585887] env[69232]: DEBUG oslo_concurrency.lockutils [None req-94066da2-e1f6-4276-9635-375c603f4834 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 547.586013] env[69232]: DEBUG oslo_concurrency.lockutils [None req-94066da2-e1f6-4276-9635-375c603f4834 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 547.586454] env[69232]: DEBUG oslo_concurrency.lockutils [None req-94066da2-e1f6-4276-9635-375c603f4834 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 547.597209] env[69232]: DEBUG oslo_concurrency.lockutils [None req-94066da2-e1f6-4276-9635-375c603f4834 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 547.879510] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-94066da2-e1f6-4276-9635-375c603f4834 None None] Session token - acquired, connected to NSX-T 4.1.2.0.0.22589037 [ 547.905038] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94066da2-e1f6-4276-9635-375c603f4834 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 547.905266] env[69232]: DEBUG dogpile.cache.region [None req-94066da2-e1f6-4276-9635-375c603f4834 None None] Cache value generated in 0.354 seconds for key(s): 'zone-id' {{(pid=69232) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 547.905718] env[69232]: DEBUG dogpile.lock [None req-94066da2-e1f6-4276-9635-375c603f4834 None None] Released creation lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 547.905718] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94066da2-e1f6-4276-9635-375c603f4834 None None] Activating Policy API Provider. [ 547.905718] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94066da2-e1f6-4276-9635-375c603f4834 None None] Looking for the default Infrastructure Rules. [ 547.973846] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94066da2-e1f6-4276-9635-375c603f4834 None None] Looking for the Default Layer3 Logged Drop Section. [ 547.993970] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-94066da2-e1f6-4276-9635-375c603f4834 None None] Detected NSX-T (4, 1, 2, 0, 0, 22589037) version. [ 547.994451] env[69232]: DEBUG networking_nsxv3.common.locking [None req-94066da2-e1f6-4276-9635-375c603f4834 None None] Lock all taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 547.994633] env[69232]: DEBUG oslo_concurrency.lockutils [None req-94066da2-e1f6-4276-9635-375c603f4834 None None] Acquiring lock "all" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 547.994741] env[69232]: DEBUG oslo_concurrency.lockutils [None req-94066da2-e1f6-4276-9635-375c603f4834 None None] Acquired lock "all" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 547.995047] env[69232]: DEBUG oslo_concurrency.lockutils [None req-94066da2-e1f6-4276-9635-375c603f4834 None None] Acquired external semaphore "all" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 547.995388] env[69232]: DEBUG networking_nsxv3.api.rpc [None req-94066da2-e1f6-4276-9635-375c603f4834 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 548.511108] env[69232]: DEBUG networking_nsxv3.api.rpc [None req-94066da2-e1f6-4276-9635-375c603f4834 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 549.013763] env[69232]: DEBUG networking_nsxv3.api.rpc [None req-94066da2-e1f6-4276-9635-375c603f4834 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 549.516324] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-94066da2-e1f6-4276-9635-375c603f4834 None None] Inventory metadata is going to be refreshed. [ 549.516788] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94066da2-e1f6-4276-9635-375c603f4834 None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 550.447191] env[69232]: DEBUG networking_nsxv3.common.locking [None req-94066da2-e1f6-4276-9635-375c603f4834 None None] Lock Segment taken with stack trace [, , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 550.447429] env[69232]: DEBUG oslo_concurrency.lockutils [None req-94066da2-e1f6-4276-9635-375c603f4834 None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 550.447527] env[69232]: DEBUG oslo_concurrency.lockutils [None req-94066da2-e1f6-4276-9635-375c603f4834 None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 550.447898] env[69232]: DEBUG oslo_concurrency.lockutils [None req-94066da2-e1f6-4276-9635-375c603f4834 None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 550.458699] env[69232]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [None req-94066da2-e1f6-4276-9635-375c603f4834 None None] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 550.459756] env[69232]: DEBUG oslo_concurrency.lockutils [None req-94066da2-e1f6-4276-9635-375c603f4834 None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 550.460689] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94066da2-e1f6-4276-9635-375c603f4834 None None] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 550.480682] env[69232]: DEBUG networking_nsxv3.common.locking [None req-94066da2-e1f6-4276-9635-375c603f4834 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 550.480948] env[69232]: DEBUG oslo_concurrency.lockutils [None req-94066da2-e1f6-4276-9635-375c603f4834 None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 550.481051] env[69232]: DEBUG oslo_concurrency.lockutils [None req-94066da2-e1f6-4276-9635-375c603f4834 None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 550.481292] env[69232]: DEBUG oslo_concurrency.lockutils [None req-94066da2-e1f6-4276-9635-375c603f4834 None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 550.481427] env[69232]: DEBUG oslo_concurrency.lockutils [None req-94066da2-e1f6-4276-9635-375c603f4834 None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 550.481583] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94066da2-e1f6-4276-9635-375c603f4834 None None] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 550.481700] env[69232]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94066da2-e1f6-4276-9635-375c603f4834 None None] Outdated resources of Type:SegmentPort Are:set() {{(pid=69232) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 550.481810] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94066da2-e1f6-4276-9635-375c603f4834 None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 550.501451] env[69232]: DEBUG networking_nsxv3.common.locking [None req-94066da2-e1f6-4276-9635-375c603f4834 None None] Lock Security Group (Rules) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 550.501690] env[69232]: DEBUG oslo_concurrency.lockutils [None req-94066da2-e1f6-4276-9635-375c603f4834 None None] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 550.501729] env[69232]: DEBUG oslo_concurrency.lockutils [None req-94066da2-e1f6-4276-9635-375c603f4834 None None] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 550.502021] env[69232]: DEBUG oslo_concurrency.lockutils [None req-94066da2-e1f6-4276-9635-375c603f4834 None None] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 550.502211] env[69232]: DEBUG oslo_concurrency.lockutils [None req-94066da2-e1f6-4276-9635-375c603f4834 None None] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 550.502363] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94066da2-e1f6-4276-9635-375c603f4834 None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 550.522217] env[69232]: DEBUG networking_nsxv3.common.locking [None req-94066da2-e1f6-4276-9635-375c603f4834 None None] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 550.522668] env[69232]: DEBUG oslo_concurrency.lockutils [None req-94066da2-e1f6-4276-9635-375c603f4834 None None] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 550.522668] env[69232]: DEBUG oslo_concurrency.lockutils [None req-94066da2-e1f6-4276-9635-375c603f4834 None None] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 550.522802] env[69232]: DEBUG oslo_concurrency.lockutils [None req-94066da2-e1f6-4276-9635-375c603f4834 None None] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 550.522924] env[69232]: DEBUG oslo_concurrency.lockutils [None req-94066da2-e1f6-4276-9635-375c603f4834 None None] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 550.523087] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94066da2-e1f6-4276-9635-375c603f4834 None None] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 550.542309] env[69232]: DEBUG networking_nsxv3.common.locking [None req-94066da2-e1f6-4276-9635-375c603f4834 None None] Lock Address Group taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 550.542505] env[69232]: DEBUG oslo_concurrency.lockutils [None req-94066da2-e1f6-4276-9635-375c603f4834 None None] Acquiring lock "Address Group" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 550.542567] env[69232]: DEBUG oslo_concurrency.lockutils [None req-94066da2-e1f6-4276-9635-375c603f4834 None None] Acquired lock "Address Group" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 550.542854] env[69232]: DEBUG oslo_concurrency.lockutils [None req-94066da2-e1f6-4276-9635-375c603f4834 None None] Acquired external semaphore "Address Group" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 550.542998] env[69232]: DEBUG oslo_concurrency.lockutils [None req-94066da2-e1f6-4276-9635-375c603f4834 None None] Releasing lock "Address Group" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 550.543169] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94066da2-e1f6-4276-9635-375c603f4834 None None] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 550.543274] env[69232]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94066da2-e1f6-4276-9635-375c603f4834 None None] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=69232) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 550.543380] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94066da2-e1f6-4276-9635-375c603f4834 None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 550.561871] env[69232]: DEBUG networking_nsxv3.common.locking [None req-94066da2-e1f6-4276-9635-375c603f4834 None None] Lock Segment QoS taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 550.562145] env[69232]: DEBUG oslo_concurrency.lockutils [None req-94066da2-e1f6-4276-9635-375c603f4834 None None] Acquiring lock "Segment QoS" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 550.562231] env[69232]: DEBUG oslo_concurrency.lockutils [None req-94066da2-e1f6-4276-9635-375c603f4834 None None] Acquired lock "Segment QoS" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 550.562515] env[69232]: DEBUG oslo_concurrency.lockutils [None req-94066da2-e1f6-4276-9635-375c603f4834 None None] Acquired external semaphore "Segment QoS" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 550.562645] env[69232]: DEBUG oslo_concurrency.lockutils [None req-94066da2-e1f6-4276-9635-375c603f4834 None None] Releasing lock "Segment QoS" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 550.562790] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94066da2-e1f6-4276-9635-375c603f4834 None None] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 550.562897] env[69232]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94066da2-e1f6-4276-9635-375c603f4834 None None] Outdated resources of Type:Segment QoS Are:set() {{(pid=69232) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 550.563014] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94066da2-e1f6-4276-9635-375c603f4834 None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 550.584756] env[69232]: DEBUG networking_nsxv3.common.locking [None req-94066da2-e1f6-4276-9635-375c603f4834 None None] Lock Security Group (Members) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 550.585042] env[69232]: DEBUG oslo_concurrency.lockutils [None req-94066da2-e1f6-4276-9635-375c603f4834 None None] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 550.585121] env[69232]: DEBUG oslo_concurrency.lockutils [None req-94066da2-e1f6-4276-9635-375c603f4834 None None] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 550.585356] env[69232]: DEBUG oslo_concurrency.lockutils [None req-94066da2-e1f6-4276-9635-375c603f4834 None None] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 550.585501] env[69232]: DEBUG oslo_concurrency.lockutils [None req-94066da2-e1f6-4276-9635-375c603f4834 None None] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 550.585662] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94066da2-e1f6-4276-9635-375c603f4834 None None] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 550.585808] env[69232]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94066da2-e1f6-4276-9635-375c603f4834 None None] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=69232) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 550.585984] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-94066da2-e1f6-4276-9635-375c603f4834 None None] Inventory metadata have been refreshed. [ 550.586118] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-94066da2-e1f6-4276-9635-375c603f4834 None None] Dryrun:True. Metadata refresh completed. [ 550.586246] env[69232]: DEBUG oslo_concurrency.lockutils [None req-94066da2-e1f6-4276-9635-375c603f4834 None None] Releasing lock "all" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 550.588081] env[69232]: INFO neutron.agent.agent_extensions_manager [None req-94066da2-e1f6-4276-9635-375c603f4834 None None] Loaded agent extensions: [] [ 550.588807] env[69232]: DEBUG neutron_lib.callbacks.manager [None req-94066da2-e1f6-4276-9635-375c603f4834 None None] Publish callbacks [] for NSXv3 Agent (None), after_init {{(pid=69232) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} [ 550.636732] env[69232]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-94066da2-e1f6-4276-9635-375c603f4834 None None] NSXv3 Agent Agent RPC Daemon Started! [ 550.636897] env[69232]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-94066da2-e1f6-4276-9635-375c603f4834 None None] NSXv3 Agent Agent loop - iteration:0 started [ 550.636965] env[69232]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-94066da2-e1f6-4276-9635-375c603f4834 None None] NSXv3 Agent Agent out of sync with plugin! [ 555.590027] env[69232]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 555.590523] env[69232]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 560.590796] env[69232]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 560.591147] env[69232]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 565.456308] env[69232]: INFO networking_nsxv3.common.synchronization [None req-2d78f178-4f5a-4818-9040-a3636a106c05 demo admin] Enqueued Resource ID: 2630f4ef-62b4-48de-b763-6b34916c1a2c with Priority: HIGHEST for action security_group_rules [ 565.456520] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2630f4ef-62b4-48de-b763-6b34916c1a2c with Priority: HIGHEST for action security_group_rules [ 565.456825] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2630f4ef-62b4-48de-b763-6b34916c1a2c taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 565.456955] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2630f4ef-62b4-48de-b763-6b34916c1a2c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 565.457035] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2630f4ef-62b4-48de-b763-6b34916c1a2c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 565.457391] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2630f4ef-62b4-48de-b763-6b34916c1a2c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 565.457474] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2630f4ef-62b4-48de-b763-6b34916c1a2c',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 565.978554] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 565.978554] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 565.978554] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 565.978828] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 565.978828] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 565.978828] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2630f4ef-62b4-48de-b763-6b34916c1a2c already deleted. [ 565.978927] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2630f4ef-62b4-48de-b763-6b34916c1a2c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 570.458381] env[69232]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 570.458806] env[69232]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 575.459877] env[69232]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 575.460109] env[69232]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 580.461508] env[69232]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 580.461878] env[69232]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 583.591797] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.592274] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.592274] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.592274] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.592485] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 584.094948] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 584.597226] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 585.099385] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 585.099578] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 585.462950] env[69232]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 585.463125] env[69232]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 585.841315] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.841687] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.841687] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.841755] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.853802] env[69232]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 585.854576] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.855206] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 585.872307] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.872494] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.872494] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.872693] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.872777] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.872881] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 585.872953] env[69232]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=69232) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 585.873037] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 585.894339] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.894555] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.894599] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.894787] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.894919] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.895038] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 585.917705] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.917925] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.917925] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.918179] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.918290] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.918402] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 585.940402] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.940654] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.940654] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.940811] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.940921] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.941052] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 585.941126] env[69232]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=69232) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 585.941199] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 585.958177] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.958381] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.958381] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.958559] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.958643] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.958746] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 585.958817] env[69232]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=69232) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 585.958888] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 585.978330] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.978541] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.978541] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.978724] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.978826] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.978938] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 585.979016] env[69232]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=69232) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 585.979102] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 585.979211] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 585.979298] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Rules [ 585.979361] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 585.979425] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 585.979684] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [ 585.979745] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [ 585.979813] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 585.999326] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.999531] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.999531] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.999693] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.999798] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.999904] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 586.021871] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.022101] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.022101] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.022232] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.022334] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.035869] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.464181] env[69232]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 590.464181] env[69232]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 594.425135] env[69232]: INFO networking_nsxv3.common.synchronization [None req-aab8e5b8-b2a6-494a-b7ee-fa3ede5eea59 None None] Enqueued Resource ID: dc5a1b27-a8d6-4e0d-ad73-c3bacf3b52d2 with Priority: HIGHEST for action port [ 594.425691] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc5a1b27-a8d6-4e0d-ad73-c3bacf3b52d2 with Priority: HIGHEST for action port [ 594.425989] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-dc5a1b27-a8d6-4e0d-ad73-c3bacf3b52d2 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.427091] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dc5a1b27-a8d6-4e0d-ad73-c3bacf3b52d2" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.427202] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dc5a1b27-a8d6-4e0d-ad73-c3bacf3b52d2" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.427428] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dc5a1b27-a8d6-4e0d-ad73-c3bacf3b52d2" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.427514] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dc5a1b27-a8d6-4e0d-ad73-c3bacf3b52d2',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.929413] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port dc5a1b27-a8d6-4e0d-ad73-c3bacf3b52d2 [ 594.930813] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.930813] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.930813] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.930813] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.930813] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.930813] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:dc5a1b27-a8d6-4e0d-ad73-c3bacf3b52d2 already deleted. [ 594.930813] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dc5a1b27-a8d6-4e0d-ad73-c3bacf3b52d2" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.478590] env[69232]: INFO networking_nsxv3.common.synchronization [None req-e516f150-a333-497d-aec2-93fd75839530 None None] Enqueued Resource ID: c1f15316-fa22-4ad0-9bd0-ed31d55fe73e with Priority: HIGHEST for action port [ 596.478862] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c1f15316-fa22-4ad0-9bd0-ed31d55fe73e with Priority: HIGHEST for action port [ 596.479614] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-c1f15316-fa22-4ad0-9bd0-ed31d55fe73e taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.479614] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c1f15316-fa22-4ad0-9bd0-ed31d55fe73e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.479614] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c1f15316-fa22-4ad0-9bd0-ed31d55fe73e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.479846] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c1f15316-fa22-4ad0-9bd0-ed31d55fe73e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.479933] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c1f15316-fa22-4ad0-9bd0-ed31d55fe73e',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.984311] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c1f15316-fa22-4ad0-9bd0-ed31d55fe73e [ 596.986022] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.986834] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.986982] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.990022] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.990022] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.990022] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c1f15316-fa22-4ad0-9bd0-ed31d55fe73e already deleted. [ 596.990022] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c1f15316-fa22-4ad0-9bd0-ed31d55fe73e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.098406] env[69232]: INFO networking_nsxv3.common.synchronization [None req-c0b48316-bde4-4848-a8fb-00612929adc6 None None] Enqueued Resource ID: 8f4cbf9a-e1ef-4432-a334-2812a13cbe57 with Priority: HIGHEST for action port [ 597.099644] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f4cbf9a-e1ef-4432-a334-2812a13cbe57 with Priority: HIGHEST for action port [ 597.099644] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-8f4cbf9a-e1ef-4432-a334-2812a13cbe57 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.099644] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8f4cbf9a-e1ef-4432-a334-2812a13cbe57" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.099644] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8f4cbf9a-e1ef-4432-a334-2812a13cbe57" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.100183] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8f4cbf9a-e1ef-4432-a334-2812a13cbe57" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.101581] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8f4cbf9a-e1ef-4432-a334-2812a13cbe57',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.603951] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8f4cbf9a-e1ef-4432-a334-2812a13cbe57 [ 597.603951] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.603951] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.603951] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.603951] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.603951] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.603951] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8f4cbf9a-e1ef-4432-a334-2812a13cbe57 already deleted. [ 597.603951] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8f4cbf9a-e1ef-4432-a334-2812a13cbe57" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.357714] env[69232]: INFO networking_nsxv3.common.synchronization [None req-b390df04-8edc-40f6-a486-6eb5636c10c1 None None] Enqueued Resource ID: 9f636bb4-c94f-40e7-8991-a28c3d3e9dcc with Priority: HIGHEST for action port [ 598.357714] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f636bb4-c94f-40e7-8991-a28c3d3e9dcc with Priority: HIGHEST for action port [ 598.357714] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-9f636bb4-c94f-40e7-8991-a28c3d3e9dcc taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.357714] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9f636bb4-c94f-40e7-8991-a28c3d3e9dcc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.357714] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9f636bb4-c94f-40e7-8991-a28c3d3e9dcc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.357714] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9f636bb4-c94f-40e7-8991-a28c3d3e9dcc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.357714] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9f636bb4-c94f-40e7-8991-a28c3d3e9dcc',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.623829] env[69232]: INFO networking_nsxv3.common.synchronization [None req-46241bd3-aa6e-4468-baee-bc8c5ff57461 None None] Enqueued Resource ID: 6238fd2d-1340-4087-ac92-0790db41ffbc with Priority: HIGHEST for action port [ 598.624111] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6238fd2d-1340-4087-ac92-0790db41ffbc with Priority: HIGHEST for action port [ 598.624656] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-6238fd2d-1340-4087-ac92-0790db41ffbc taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.624812] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6238fd2d-1340-4087-ac92-0790db41ffbc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.624936] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6238fd2d-1340-4087-ac92-0790db41ffbc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.625129] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6238fd2d-1340-4087-ac92-0790db41ffbc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.625245] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6238fd2d-1340-4087-ac92-0790db41ffbc',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.861209] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9f636bb4-c94f-40e7-8991-a28c3d3e9dcc [ 598.861209] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.861370] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.861415] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.861617] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.861705] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.861795] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9f636bb4-c94f-40e7-8991-a28c3d3e9dcc already deleted. [ 598.861872] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9f636bb4-c94f-40e7-8991-a28c3d3e9dcc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.129921] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6238fd2d-1340-4087-ac92-0790db41ffbc [ 599.130332] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.130332] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.130471] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.130733] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.134501] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.134501] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6238fd2d-1340-4087-ac92-0790db41ffbc already deleted. [ 599.134501] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6238fd2d-1340-4087-ac92-0790db41ffbc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.247027] env[69232]: INFO networking_nsxv3.common.synchronization [None req-54ebb653-6b03-4651-9a10-8f7c7ce503d9 None None] Enqueued Resource ID: 28b16fbb-1fde-4f59-8fba-22f67a1a77b7 with Priority: HIGHEST for action port [ 599.247027] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28b16fbb-1fde-4f59-8fba-22f67a1a77b7 with Priority: HIGHEST for action port [ 599.247027] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-28b16fbb-1fde-4f59-8fba-22f67a1a77b7 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.247027] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-28b16fbb-1fde-4f59-8fba-22f67a1a77b7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.247027] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-28b16fbb-1fde-4f59-8fba-22f67a1a77b7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.248997] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-28b16fbb-1fde-4f59-8fba-22f67a1a77b7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.249227] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('28b16fbb-1fde-4f59-8fba-22f67a1a77b7',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.414470] env[69232]: INFO networking_nsxv3.common.synchronization [None req-c93f623b-a4d2-4949-8648-ef2ae419efd2 None None] Enqueued Resource ID: 7b03b405-6aba-4e6e-ad8e-4843c7d2669e with Priority: HIGHEST for action port [ 599.414470] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b03b405-6aba-4e6e-ad8e-4843c7d2669e with Priority: HIGHEST for action port [ 599.414793] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-7b03b405-6aba-4e6e-ad8e-4843c7d2669e taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.414929] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7b03b405-6aba-4e6e-ad8e-4843c7d2669e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.414994] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7b03b405-6aba-4e6e-ad8e-4843c7d2669e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.417346] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7b03b405-6aba-4e6e-ad8e-4843c7d2669e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.417447] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7b03b405-6aba-4e6e-ad8e-4843c7d2669e',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.751219] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 28b16fbb-1fde-4f59-8fba-22f67a1a77b7 [ 599.751538] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.751658] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.752785] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.752785] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.752785] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.752785] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:28b16fbb-1fde-4f59-8fba-22f67a1a77b7 already deleted. [ 599.752785] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-28b16fbb-1fde-4f59-8fba-22f67a1a77b7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.923923] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7b03b405-6aba-4e6e-ad8e-4843c7d2669e [ 599.923923] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.923923] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.923923] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.923923] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.923923] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.923923] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7b03b405-6aba-4e6e-ad8e-4843c7d2669e already deleted. [ 599.924241] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7b03b405-6aba-4e6e-ad8e-4843c7d2669e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.702231] env[69232]: INFO networking_nsxv3.common.synchronization [None req-47399256-31ad-4a6e-8fb7-9a3a45e6cc74 None None] Enqueued Resource ID: 3803772a-2e66-4a26-927f-f2c7a688aef6 with Priority: HIGHEST for action port [ 600.702746] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3803772a-2e66-4a26-927f-f2c7a688aef6 with Priority: HIGHEST for action port [ 600.704393] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-3803772a-2e66-4a26-927f-f2c7a688aef6 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.704563] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3803772a-2e66-4a26-927f-f2c7a688aef6" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.704698] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3803772a-2e66-4a26-927f-f2c7a688aef6" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.704986] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3803772a-2e66-4a26-927f-f2c7a688aef6" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.705087] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3803772a-2e66-4a26-927f-f2c7a688aef6',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.074563] env[69232]: INFO networking_nsxv3.common.synchronization [None req-427e3b5e-c60c-4d12-a363-bfdd7f0ff738 tempest-ServersTestJSON-1956507718 tempest-ServersTestJSON-1956507718-project-member] Enqueued Resource ID: 21513cb2-4b6e-4c9f-864c-d3d144ce0d57 with Priority: HIGHEST for action security_group_rules [ 601.075312] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21513cb2-4b6e-4c9f-864c-d3d144ce0d57 with Priority: HIGHEST for action security_group_rules [ 601.075428] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-21513cb2-4b6e-4c9f-864c-d3d144ce0d57 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.075556] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-21513cb2-4b6e-4c9f-864c-d3d144ce0d57" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.075626] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-21513cb2-4b6e-4c9f-864c-d3d144ce0d57" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.075878] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-21513cb2-4b6e-4c9f-864c-d3d144ce0d57" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.075955] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('21513cb2-4b6e-4c9f-864c-d3d144ce0d57',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.194625] env[69232]: INFO networking_nsxv3.common.synchronization [None req-c5959759-24bb-48e9-84cf-ef5b7870b83c tempest-ServersTestJSON-1956507718 tempest-ServersTestJSON-1956507718-project-member] Enqueued Resource ID: 21513cb2-4b6e-4c9f-864c-d3d144ce0d57 with Priority: HIGHEST for action security_group_rules [ 601.195551] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21513cb2-4b6e-4c9f-864c-d3d144ce0d57 with Priority: HIGHEST for action security_group_rules [ 601.195551] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-21513cb2-4b6e-4c9f-864c-d3d144ce0d57 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.195819] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-21513cb2-4b6e-4c9f-864c-d3d144ce0d57" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.208322] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3803772a-2e66-4a26-927f-f2c7a688aef6 [ 601.208438] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.208929] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.209118] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.210115] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.210115] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.210115] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3803772a-2e66-4a26-927f-f2c7a688aef6 already deleted. [ 601.210115] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3803772a-2e66-4a26-927f-f2c7a688aef6" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.486638] env[69232]: INFO networking_nsxv3.common.synchronization [None req-4ca72d7d-3d0f-4566-8bf4-d8196c0acf88 None None] Enqueued Resource ID: a2a0bfc6-fefc-4dd8-8683-8ac1e2f10655 with Priority: HIGHEST for action port [ 601.487235] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2a0bfc6-fefc-4dd8-8683-8ac1e2f10655 with Priority: HIGHEST for action port [ 601.487539] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-a2a0bfc6-fefc-4dd8-8683-8ac1e2f10655 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.487794] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a2a0bfc6-fefc-4dd8-8683-8ac1e2f10655" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.487794] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a2a0bfc6-fefc-4dd8-8683-8ac1e2f10655" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.488027] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a2a0bfc6-fefc-4dd8-8683-8ac1e2f10655" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.488119] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a2a0bfc6-fefc-4dd8-8683-8ac1e2f10655',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.598528] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.598661] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.598730] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.598942] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.599042] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.599135] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 21513cb2-4b6e-4c9f-864c-d3d144ce0d57 already deleted. [ 601.599216] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-21513cb2-4b6e-4c9f-864c-d3d144ce0d57" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.599375] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-21513cb2-4b6e-4c9f-864c-d3d144ce0d57" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.599533] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-21513cb2-4b6e-4c9f-864c-d3d144ce0d57" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.599609] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('21513cb2-4b6e-4c9f-864c-d3d144ce0d57',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.990087] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a2a0bfc6-fefc-4dd8-8683-8ac1e2f10655 [ 601.990332] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.990471] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.991103] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.991103] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.991103] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.991103] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a2a0bfc6-fefc-4dd8-8683-8ac1e2f10655 already deleted. [ 601.991103] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a2a0bfc6-fefc-4dd8-8683-8ac1e2f10655" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.125201] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.125201] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.125201] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.125499] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.125668] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.125723] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 21513cb2-4b6e-4c9f-864c-d3d144ce0d57 already deleted. [ 602.125920] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-21513cb2-4b6e-4c9f-864c-d3d144ce0d57" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.141244] env[69232]: INFO networking_nsxv3.common.synchronization [None req-7e482778-ee5c-4011-969d-35502ce2d5b2 None None] Enqueued Resource ID: 65c82acf-f816-4be9-b2b4-14fe6671966d with Priority: HIGHEST for action port [ 602.141244] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 65c82acf-f816-4be9-b2b4-14fe6671966d with Priority: HIGHEST for action port [ 602.141244] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-65c82acf-f816-4be9-b2b4-14fe6671966d taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.141244] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-65c82acf-f816-4be9-b2b4-14fe6671966d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.141244] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-65c82acf-f816-4be9-b2b4-14fe6671966d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.141244] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-65c82acf-f816-4be9-b2b4-14fe6671966d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.141244] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('65c82acf-f816-4be9-b2b4-14fe6671966d',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.238574] env[69232]: INFO networking_nsxv3.common.synchronization [None req-522107b9-972b-4ebc-a466-b84509233bad None None] Enqueued Resource ID: e04483e4-dc15-46fa-8850-062d66e0903d with Priority: HIGHEST for action port [ 602.239439] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e04483e4-dc15-46fa-8850-062d66e0903d with Priority: HIGHEST for action port [ 602.239572] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-e04483e4-dc15-46fa-8850-062d66e0903d taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.240127] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e04483e4-dc15-46fa-8850-062d66e0903d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.240127] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e04483e4-dc15-46fa-8850-062d66e0903d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.240475] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e04483e4-dc15-46fa-8850-062d66e0903d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.240613] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e04483e4-dc15-46fa-8850-062d66e0903d',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.642367] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 65c82acf-f816-4be9-b2b4-14fe6671966d [ 602.642625] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.642743] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.642796] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.642975] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.643084] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.643181] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:65c82acf-f816-4be9-b2b4-14fe6671966d already deleted. [ 602.643265] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-65c82acf-f816-4be9-b2b4-14fe6671966d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.745884] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e04483e4-dc15-46fa-8850-062d66e0903d [ 602.746132] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.746264] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.746343] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.746650] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.746768] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.747319] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e04483e4-dc15-46fa-8850-062d66e0903d already deleted. [ 602.747319] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e04483e4-dc15-46fa-8850-062d66e0903d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.182918] env[69232]: INFO networking_nsxv3.common.synchronization [None req-3d5c8596-f1ac-4cfc-92d4-c703c2c5d5c5 None None] Enqueued Resource ID: fa763a15-4e1e-4718-91a5-dd467aaa5d51 with Priority: HIGHEST for action port [ 603.184571] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa763a15-4e1e-4718-91a5-dd467aaa5d51 with Priority: HIGHEST for action port [ 603.184571] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-fa763a15-4e1e-4718-91a5-dd467aaa5d51 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.184571] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fa763a15-4e1e-4718-91a5-dd467aaa5d51" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.184571] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fa763a15-4e1e-4718-91a5-dd467aaa5d51" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.184571] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fa763a15-4e1e-4718-91a5-dd467aaa5d51" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.184999] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fa763a15-4e1e-4718-91a5-dd467aaa5d51',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.688045] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fa763a15-4e1e-4718-91a5-dd467aaa5d51 [ 603.688204] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.688381] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.688445] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.688645] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.688740] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.688836] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fa763a15-4e1e-4718-91a5-dd467aaa5d51 already deleted. [ 603.688918] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fa763a15-4e1e-4718-91a5-dd467aaa5d51" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.727999] env[69232]: INFO networking_nsxv3.common.synchronization [None req-bf7c4d8a-3ca7-4d03-9e26-bbd57a95ade1 None None] Enqueued Resource ID: 0b1d823a-8545-4123-a416-7f4608b9caa2 with Priority: HIGHEST for action port [ 604.728700] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b1d823a-8545-4123-a416-7f4608b9caa2 with Priority: HIGHEST for action port [ 604.729091] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-0b1d823a-8545-4123-a416-7f4608b9caa2 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.729259] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0b1d823a-8545-4123-a416-7f4608b9caa2" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.729695] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0b1d823a-8545-4123-a416-7f4608b9caa2" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.730162] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0b1d823a-8545-4123-a416-7f4608b9caa2" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.730162] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0b1d823a-8545-4123-a416-7f4608b9caa2',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.232190] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0b1d823a-8545-4123-a416-7f4608b9caa2 [ 605.232623] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.232783] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.232890] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.233093] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.233415] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.233415] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0b1d823a-8545-4123-a416-7f4608b9caa2 already deleted. [ 605.233415] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0b1d823a-8545-4123-a416-7f4608b9caa2" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.617412] env[69232]: INFO networking_nsxv3.common.synchronization [req-35756ee8-29fb-4fed-a0d2-152517eab575 req-36cb6e4f-5724-421b-acda-aed074df7fc6 tempest-DeleteServersAdminTestJSON-46940546 tempest-DeleteServersAdminTestJSON-46940546-project-member] Enqueued Resource ID: 04c8afd4-5b6b-40d6-827e-7916015a1e43 with Priority: HIGHEST for action security_group_members [ 605.617412] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04c8afd4-5b6b-40d6-827e-7916015a1e43 with Priority: HIGHEST for action security_group_members [ 605.619823] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-04c8afd4-5b6b-40d6-827e-7916015a1e43 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.619823] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04c8afd4-5b6b-40d6-827e-7916015a1e43" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.619823] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04c8afd4-5b6b-40d6-827e-7916015a1e43" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.619823] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04c8afd4-5b6b-40d6-827e-7916015a1e43" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.619823] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.619823] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.619823] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.621298] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.621298] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.621298] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('04c8afd4-5b6b-40d6-827e-7916015a1e43',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.126570] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.126860] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.126860] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.127749] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.127749] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.127749] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.127749] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.127749] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.127749] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.127749] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.128093] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 04c8afd4-5b6b-40d6-827e-7916015a1e43 already deleted. [ 606.128093] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04c8afd4-5b6b-40d6-827e-7916015a1e43" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.367664] env[69232]: INFO networking_nsxv3.common.synchronization [None req-e5ea5701-5d1c-42be-b319-2ada6bc1a597 None None] Enqueued Resource ID: 828d5147-89d3-48ee-b9d9-532de97065e8 with Priority: HIGHEST for action port [ 606.368643] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 828d5147-89d3-48ee-b9d9-532de97065e8 with Priority: HIGHEST for action port [ 606.368643] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-828d5147-89d3-48ee-b9d9-532de97065e8 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.368786] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-828d5147-89d3-48ee-b9d9-532de97065e8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.368840] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-828d5147-89d3-48ee-b9d9-532de97065e8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.369784] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-828d5147-89d3-48ee-b9d9-532de97065e8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.369925] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('828d5147-89d3-48ee-b9d9-532de97065e8',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.653982] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock network-225 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.653982] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "network-225" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.653982] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "network-225" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.653982] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "network-225" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.653982] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.653982] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.653982] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.654401] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.654492] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.654751] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 606.654872] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] NeedRegenerationException {{(pid=69232) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 606.654986] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] no value, waiting for create lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 606.655114] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] value creation lock acquired {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 606.655234] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 606.656246] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Calling creation function for not-yet-present value {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 606.656246] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 606.676135] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 606.676519] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69232) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 606.676519] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Released creation lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 606.676667] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "network-225" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.676966] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock port-d7e52e99-2279-4d6c-a0db-b4d312cf4f98 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.677171] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "port-d7e52e99-2279-4d6c-a0db-b4d312cf4f98" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.677296] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "port-d7e52e99-2279-4d6c-a0db-b4d312cf4f98" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.677601] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "port-d7e52e99-2279-4d6c-a0db-b4d312cf4f98" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.677741] env[69232]: DEBUG networking_nsxv3.api.rpc [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d7e52e99-2279-4d6c-a0db-b4d312cf4f98',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.872444] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 828d5147-89d3-48ee-b9d9-532de97065e8 [ 606.873600] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.873600] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.873600] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.873600] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.873600] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.873600] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:828d5147-89d3-48ee-b9d9-532de97065e8 already deleted. [ 606.873600] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-828d5147-89d3-48ee-b9d9-532de97065e8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.180459] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.181520] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.181520] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.181520] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.181520] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.181675] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Segment Port d7e52e99-2279-4d6c-a0db-b4d312cf4f98 not found, creating... [ 607.181896] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.181998] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.182185] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.183028] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.183028] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.183028] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.183028] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.183243] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.183470] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.183470] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.183587] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Resource: SegmentPort with ID: d7e52e99-2279-4d6c-a0db-b4d312cf4f98 is going to be created. [ 607.211333] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.211333] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.211333] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.211333] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.211333] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.211630] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "port-d7e52e99-2279-4d6c-a0db-b4d312cf4f98" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.426665] env[69232]: INFO networking_nsxv3.common.synchronization [None req-a8b68097-0faf-475c-97ae-8d609f84b66f None None] Enqueued Resource ID: 7a5e6498-ed97-417d-8218-346338344a75 with Priority: HIGHEST for action port [ 607.427836] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a5e6498-ed97-417d-8218-346338344a75 with Priority: HIGHEST for action port [ 607.427836] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-7a5e6498-ed97-417d-8218-346338344a75 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.427836] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7a5e6498-ed97-417d-8218-346338344a75" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.427836] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7a5e6498-ed97-417d-8218-346338344a75" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.427836] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7a5e6498-ed97-417d-8218-346338344a75" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.428035] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7a5e6498-ed97-417d-8218-346338344a75',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.934905] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7a5e6498-ed97-417d-8218-346338344a75 [ 607.935147] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.935288] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.935361] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.935579] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.936132] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.936132] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7a5e6498-ed97-417d-8218-346338344a75 already deleted. [ 607.936132] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7a5e6498-ed97-417d-8218-346338344a75" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.192329] env[69232]: INFO networking_nsxv3.common.synchronization [req-35756ee8-29fb-4fed-a0d2-152517eab575 req-128d73c4-1d07-4f94-ba51-ebd0721367aa service nova] Enqueued Resource ID: 04c8afd4-5b6b-40d6-827e-7916015a1e43 with Priority: HIGHEST for action security_group_rules [ 608.192786] env[69232]: INFO networking_nsxv3.common.synchronization [req-35756ee8-29fb-4fed-a0d2-152517eab575 req-128d73c4-1d07-4f94-ba51-ebd0721367aa service nova] Enqueued Resource ID: 04c8afd4-5b6b-40d6-827e-7916015a1e43 with Priority: HIGHEST for action security_group_members [ 608.192927] env[69232]: INFO networking_nsxv3.common.synchronization [req-35756ee8-29fb-4fed-a0d2-152517eab575 req-128d73c4-1d07-4f94-ba51-ebd0721367aa service nova] Enqueued Resource ID: d7e52e99-2279-4d6c-a0db-b4d312cf4f98 with Priority: HIGHEST for action port [ 608.193640] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04c8afd4-5b6b-40d6-827e-7916015a1e43 with Priority: HIGHEST for action security_group_rules [ 608.194388] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04c8afd4-5b6b-40d6-827e-7916015a1e43 with Priority: HIGHEST for action security_group_members [ 608.194388] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7e52e99-2279-4d6c-a0db-b4d312cf4f98 with Priority: HIGHEST for action port [ 608.194388] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-04c8afd4-5b6b-40d6-827e-7916015a1e43 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.194639] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-04c8afd4-5b6b-40d6-827e-7916015a1e43" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.194639] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-04c8afd4-5b6b-40d6-827e-7916015a1e43" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.194856] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-04c8afd4-5b6b-40d6-827e-7916015a1e43" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.194975] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('04c8afd4-5b6b-40d6-827e-7916015a1e43',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.196301] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-04c8afd4-5b6b-40d6-827e-7916015a1e43 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.196504] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04c8afd4-5b6b-40d6-827e-7916015a1e43" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.196590] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04c8afd4-5b6b-40d6-827e-7916015a1e43" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.196937] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04c8afd4-5b6b-40d6-827e-7916015a1e43" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.197138] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.198035] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.198035] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.198035] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.198035] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.198035] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('04c8afd4-5b6b-40d6-827e-7916015a1e43',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.201494] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-d7e52e99-2279-4d6c-a0db-b4d312cf4f98 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.201494] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d7e52e99-2279-4d6c-a0db-b4d312cf4f98" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.201494] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d7e52e99-2279-4d6c-a0db-b4d312cf4f98" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.201494] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d7e52e99-2279-4d6c-a0db-b4d312cf4f98" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.201494] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d7e52e99-2279-4d6c-a0db-b4d312cf4f98',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.423752] env[69232]: INFO networking_nsxv3.common.synchronization [None req-a86d7743-bf01-4a56-8351-20375f4116e9 None None] Enqueued Resource ID: 46f60806-e0de-4bc6-ae2b-99980c0dfed1 with Priority: HIGHEST for action port [ 608.423752] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46f60806-e0de-4bc6-ae2b-99980c0dfed1 with Priority: HIGHEST for action port [ 608.423752] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-46f60806-e0de-4bc6-ae2b-99980c0dfed1 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.423752] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-46f60806-e0de-4bc6-ae2b-99980c0dfed1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.423752] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-46f60806-e0de-4bc6-ae2b-99980c0dfed1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.423752] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-46f60806-e0de-4bc6-ae2b-99980c0dfed1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.423752] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('46f60806-e0de-4bc6-ae2b-99980c0dfed1',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.703335] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-04c8afd4-5b6b-40d6-827e-7916015a1e43 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.703335] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04c8afd4-5b6b-40d6-827e-7916015a1e43" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.709445] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d7e52e99-2279-4d6c-a0db-b4d312cf4f98 with status ACTIVE [ 608.710546] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.714021] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.714021] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.714021] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.714021] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.714021] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.714021] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.714021] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.714021] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.714021] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.714021] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.714021] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.714021] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.714021] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.714021] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.714021] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d7e52e99-2279-4d6c-a0db-b4d312cf4f98 is going to be updated. [ 608.714021] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('04c8afd4-5b6b-40d6-827e-7916015a1e43',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.738497] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.738703] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.738784] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.738995] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.739167] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.739366] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d7e52e99-2279-4d6c-a0db-b4d312cf4f98" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.927289] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 46f60806-e0de-4bc6-ae2b-99980c0dfed1 [ 608.927505] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.927635] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.927705] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.927925] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.928019] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.928202] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:46f60806-e0de-4bc6-ae2b-99980c0dfed1 already deleted. [ 608.928202] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-46f60806-e0de-4bc6-ae2b-99980c0dfed1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.929107] env[69232]: INFO networking_nsxv3.common.synchronization [None req-362d18ad-e6a5-4eb7-bf19-c2a024e0ea59 tempest-VolumesAssistedSnapshotsTest-1395395803 tempest-VolumesAssistedSnapshotsTest-1395395803-project-member] Enqueued Resource ID: c042e2fd-851d-4970-9cfd-994d6fa3bc3a with Priority: HIGHEST for action security_group_rules [ 608.929640] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c042e2fd-851d-4970-9cfd-994d6fa3bc3a with Priority: HIGHEST for action security_group_rules [ 608.929997] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c042e2fd-851d-4970-9cfd-994d6fa3bc3a taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.930663] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c042e2fd-851d-4970-9cfd-994d6fa3bc3a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.930736] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c042e2fd-851d-4970-9cfd-994d6fa3bc3a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.930908] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c042e2fd-851d-4970-9cfd-994d6fa3bc3a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.930999] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c042e2fd-851d-4970-9cfd-994d6fa3bc3a',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.012660] env[69232]: INFO networking_nsxv3.common.synchronization [None req-1ca556cc-9266-49f4-817a-6797e0bbb181 tempest-VolumesAssistedSnapshotsTest-1395395803 tempest-VolumesAssistedSnapshotsTest-1395395803-project-member] Enqueued Resource ID: c042e2fd-851d-4970-9cfd-994d6fa3bc3a with Priority: HIGHEST for action security_group_rules [ 609.012660] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c042e2fd-851d-4970-9cfd-994d6fa3bc3a with Priority: HIGHEST for action security_group_rules [ 609.012660] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c042e2fd-851d-4970-9cfd-994d6fa3bc3a taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.012660] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c042e2fd-851d-4970-9cfd-994d6fa3bc3a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.217872] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('04c8afd4-5b6b-40d6-827e-7916015a1e43',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.450783] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.450954] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.451035] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.451260] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.451365] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.451481] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c042e2fd-851d-4970-9cfd-994d6fa3bc3a already deleted. [ 609.451590] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c042e2fd-851d-4970-9cfd-994d6fa3bc3a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.451748] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c042e2fd-851d-4970-9cfd-994d6fa3bc3a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.451903] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c042e2fd-851d-4970-9cfd-994d6fa3bc3a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.451987] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c042e2fd-851d-4970-9cfd-994d6fa3bc3a',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.721104] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.722353] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.724203] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.724436] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.724528] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.724680] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 04c8afd4-5b6b-40d6-827e-7916015a1e43 is going to be created. [ 609.756021] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.756021] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.756021] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.756166] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.757885] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.769646] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 04c8afd4-5b6b-40d6-827e-7916015a1e43 in Status: UNINITIALIZED for 2s [ 609.974982] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.974982] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.974982] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.974982] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.974982] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.974982] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c042e2fd-851d-4970-9cfd-994d6fa3bc3a already deleted. [ 609.974982] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c042e2fd-851d-4970-9cfd-994d6fa3bc3a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.135337] env[69232]: INFO networking_nsxv3.common.synchronization [req-74c8692e-01d5-48f0-9e1f-ee922f146089 req-853cc976-856e-4631-9f5d-dd39b4e194b8 tempest-MigrationsAdminTest-606964981 tempest-MigrationsAdminTest-606964981-project-member] Enqueued Resource ID: 531d0f92-2e98-47df-b32d-d49e1d2f34c1 with Priority: HIGHEST for action security_group_members [ 610.135946] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 531d0f92-2e98-47df-b32d-d49e1d2f34c1 with Priority: HIGHEST for action security_group_members [ 610.136279] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-531d0f92-2e98-47df-b32d-d49e1d2f34c1 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.136452] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-531d0f92-2e98-47df-b32d-d49e1d2f34c1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.136514] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-531d0f92-2e98-47df-b32d-d49e1d2f34c1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.136831] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-531d0f92-2e98-47df-b32d-d49e1d2f34c1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.137275] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.137275] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.137275] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.137402] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.137473] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.137623] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('531d0f92-2e98-47df-b32d-d49e1d2f34c1',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.641592] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.641592] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.641592] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.641592] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.641592] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.641592] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.641592] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.641592] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.641592] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.641592] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.641592] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 531d0f92-2e98-47df-b32d-d49e1d2f34c1 already deleted. [ 610.641592] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-531d0f92-2e98-47df-b32d-d49e1d2f34c1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.077929] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock network-225 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.078613] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "network-225" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.080510] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "network-225" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.080912] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "network-225" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.081442] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.081442] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.081610] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.081899] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.082217] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.082578] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 611.082636] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] NeedRegenerationException {{(pid=69232) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 611.082805] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] no value, waiting for create lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 611.083028] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] value creation lock acquired {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 611.083208] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 611.083377] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Calling creation function for not-yet-present value {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 611.083571] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 611.109597] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 611.109597] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=69232) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 611.109597] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Released creation lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 611.109597] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "network-225" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.112019] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock port-f169ad24-cb16-4605-bbb8-24c573c828c0 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.112019] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "port-f169ad24-cb16-4605-bbb8-24c573c828c0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.112019] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "port-f169ad24-cb16-4605-bbb8-24c573c828c0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.112019] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "port-f169ad24-cb16-4605-bbb8-24c573c828c0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.112019] env[69232]: DEBUG networking_nsxv3.api.rpc [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f169ad24-cb16-4605-bbb8-24c573c828c0',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.614017] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.614267] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.614435] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.614763] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.614965] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.615179] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Segment Port f169ad24-cb16-4605-bbb8-24c573c828c0 not found, creating... [ 611.615549] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.615714] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.615956] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.616163] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.616343] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.617160] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.617391] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.617598] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.617810] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.617996] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.618283] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Resource: SegmentPort with ID: f169ad24-cb16-4605-bbb8-24c573c828c0 is going to be created. [ 611.645302] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.645891] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.646127] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.646461] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.646674] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.646907] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "port-f169ad24-cb16-4605-bbb8-24c573c828c0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.790733] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 04c8afd4-5b6b-40d6-827e-7916015a1e43 in Status: SUCCESS [ 611.791278] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04c8afd4-5b6b-40d6-827e-7916015a1e43" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.791375] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04c8afd4-5b6b-40d6-827e-7916015a1e43" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.791588] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04c8afd4-5b6b-40d6-827e-7916015a1e43" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.791741] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.791864] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.791929] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.792116] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.792173] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.792258] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04c8afd4-5b6b-40d6-827e-7916015a1e43" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.792350] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('04c8afd4-5b6b-40d6-827e-7916015a1e43',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.924482] env[69232]: INFO networking_nsxv3.common.synchronization [None req-ab4c4676-9fec-42a8-b73d-40197f9037b8 tempest-ServersWithSpecificFlavorTestJSON-338716906 tempest-ServersWithSpecificFlavorTestJSON-338716906-project-member] Enqueued Resource ID: 06438b8f-6cee-4263-9d4c-43067bbe0a4c with Priority: HIGHEST for action security_group_rules [ 611.925163] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06438b8f-6cee-4263-9d4c-43067bbe0a4c with Priority: HIGHEST for action security_group_rules [ 611.928607] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-06438b8f-6cee-4263-9d4c-43067bbe0a4c taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.928607] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-06438b8f-6cee-4263-9d4c-43067bbe0a4c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.928607] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-06438b8f-6cee-4263-9d4c-43067bbe0a4c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.929048] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-06438b8f-6cee-4263-9d4c-43067bbe0a4c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.930204] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('06438b8f-6cee-4263-9d4c-43067bbe0a4c',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.296228] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-04c8afd4-5b6b-40d6-827e-7916015a1e43 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.296565] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04c8afd4-5b6b-40d6-827e-7916015a1e43" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.296565] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04c8afd4-5b6b-40d6-827e-7916015a1e43" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.297459] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04c8afd4-5b6b-40d6-827e-7916015a1e43" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.297667] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.297857] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.297857] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.298024] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.298126] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.298371] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04c8afd4-5b6b-40d6-827e-7916015a1e43" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.298371] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-04c8afd4-5b6b-40d6-827e-7916015a1e43 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.298540] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04c8afd4-5b6b-40d6-827e-7916015a1e43" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.298626] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04c8afd4-5b6b-40d6-827e-7916015a1e43" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.298797] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04c8afd4-5b6b-40d6-827e-7916015a1e43" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.299044] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.299303] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.299303] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.299422] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.299540] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.300089] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04c8afd4-5b6b-40d6-827e-7916015a1e43" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.300089] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('04c8afd4-5b6b-40d6-827e-7916015a1e43',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.374010] env[69232]: INFO networking_nsxv3.common.synchronization [None req-7ef18314-8a7f-4135-be6b-87dff126407e None None] Enqueued Resource ID: 31043afe-6efd-4771-a1cd-4af8b45de6cc with Priority: HIGHEST for action port [ 612.374010] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31043afe-6efd-4771-a1cd-4af8b45de6cc with Priority: HIGHEST for action port [ 612.374599] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-31043afe-6efd-4771-a1cd-4af8b45de6cc taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.375182] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-31043afe-6efd-4771-a1cd-4af8b45de6cc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.375182] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-31043afe-6efd-4771-a1cd-4af8b45de6cc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.377438] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-31043afe-6efd-4771-a1cd-4af8b45de6cc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.377438] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('31043afe-6efd-4771-a1cd-4af8b45de6cc',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.453116] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.454623] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.454623] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.454623] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.454623] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.454623] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 06438b8f-6cee-4263-9d4c-43067bbe0a4c already deleted. [ 612.454623] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-06438b8f-6cee-4263-9d4c-43067bbe0a4c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.472313] env[69232]: INFO networking_nsxv3.common.synchronization [None req-f58cd86b-aeee-4e15-be16-ea0634d191a4 tempest-ServersWithSpecificFlavorTestJSON-338716906 tempest-ServersWithSpecificFlavorTestJSON-338716906-project-member] Enqueued Resource ID: 06438b8f-6cee-4263-9d4c-43067bbe0a4c with Priority: HIGHEST for action security_group_rules [ 612.472833] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06438b8f-6cee-4263-9d4c-43067bbe0a4c with Priority: HIGHEST for action security_group_rules [ 612.475886] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-06438b8f-6cee-4263-9d4c-43067bbe0a4c taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.476065] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-06438b8f-6cee-4263-9d4c-43067bbe0a4c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.476169] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-06438b8f-6cee-4263-9d4c-43067bbe0a4c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.476509] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-06438b8f-6cee-4263-9d4c-43067bbe0a4c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.476621] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('06438b8f-6cee-4263-9d4c-43067bbe0a4c',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.804699] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 04c8afd4-5b6b-40d6-827e-7916015a1e43: rpc.has_security_group_logging(os_id): False [ 612.829335] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.829335] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.829335] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.829335] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.829335] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.829335] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.829335] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.829335] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.829335] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.829335] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.829335] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.829335] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.829335] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.829335] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.829335] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.829870] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.829870] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.829870] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.829870] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.829870] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.830025] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 04c8afd4-5b6b-40d6-827e-7916015a1e43 is going to be created. [ 612.880128] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 31043afe-6efd-4771-a1cd-4af8b45de6cc [ 612.880641] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.880896] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.880991] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.881327] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.881495] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.881564] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:31043afe-6efd-4771-a1cd-4af8b45de6cc already deleted. [ 612.881692] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-31043afe-6efd-4771-a1cd-4af8b45de6cc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.899929] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.899929] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.899929] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.899929] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.899929] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.912425] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 04c8afd4-5b6b-40d6-827e-7916015a1e43 in Status: IN_PROGRESS for 2s [ 613.002629] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.002830] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.002882] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.003132] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.003260] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.003320] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 06438b8f-6cee-4263-9d4c-43067bbe0a4c already deleted. [ 613.003399] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-06438b8f-6cee-4263-9d4c-43067bbe0a4c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.256221] env[69232]: INFO networking_nsxv3.common.synchronization [req-e35dc0f4-af3b-4cc3-a3af-f120a6a8ddfc req-deb8da37-ff8f-42b7-be56-bda2af8d1722 tempest-ServerDiagnosticsTest-552915207 tempest-ServerDiagnosticsTest-552915207-project-member] Enqueued Resource ID: aa535b82-e1cd-4d4a-9994-f97b75b51d5e with Priority: HIGHEST for action security_group_members [ 613.256221] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa535b82-e1cd-4d4a-9994-f97b75b51d5e with Priority: HIGHEST for action security_group_members [ 613.256701] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa535b82-e1cd-4d4a-9994-f97b75b51d5e taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.258033] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa535b82-e1cd-4d4a-9994-f97b75b51d5e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.258891] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa535b82-e1cd-4d4a-9994-f97b75b51d5e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.261087] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa535b82-e1cd-4d4a-9994-f97b75b51d5e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.261087] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.261087] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.261087] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.261087] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.261087] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.261087] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa535b82-e1cd-4d4a-9994-f97b75b51d5e',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.682272] env[69232]: INFO networking_nsxv3.common.synchronization [req-74c8692e-01d5-48f0-9e1f-ee922f146089 req-8f8ff5d5-a274-4626-813b-be8dc06e0eda service nova] Enqueued Resource ID: 531d0f92-2e98-47df-b32d-d49e1d2f34c1 with Priority: HIGHEST for action security_group_rules [ 613.684210] env[69232]: INFO networking_nsxv3.common.synchronization [req-74c8692e-01d5-48f0-9e1f-ee922f146089 req-8f8ff5d5-a274-4626-813b-be8dc06e0eda service nova] Enqueued Resource ID: 531d0f92-2e98-47df-b32d-d49e1d2f34c1 with Priority: HIGHEST for action security_group_members [ 613.684210] env[69232]: INFO networking_nsxv3.common.synchronization [req-74c8692e-01d5-48f0-9e1f-ee922f146089 req-8f8ff5d5-a274-4626-813b-be8dc06e0eda service nova] Enqueued Resource ID: f169ad24-cb16-4605-bbb8-24c573c828c0 with Priority: HIGHEST for action port [ 613.684210] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 531d0f92-2e98-47df-b32d-d49e1d2f34c1 with Priority: HIGHEST for action security_group_rules [ 613.685174] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 531d0f92-2e98-47df-b32d-d49e1d2f34c1 with Priority: HIGHEST for action security_group_members [ 613.685174] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f169ad24-cb16-4605-bbb8-24c573c828c0 with Priority: HIGHEST for action port [ 613.685174] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-531d0f92-2e98-47df-b32d-d49e1d2f34c1 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.685174] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-531d0f92-2e98-47df-b32d-d49e1d2f34c1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.686172] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-531d0f92-2e98-47df-b32d-d49e1d2f34c1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.686172] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-531d0f92-2e98-47df-b32d-d49e1d2f34c1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.686515] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('531d0f92-2e98-47df-b32d-d49e1d2f34c1',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.689737] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-531d0f92-2e98-47df-b32d-d49e1d2f34c1 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.689737] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-531d0f92-2e98-47df-b32d-d49e1d2f34c1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.689737] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-531d0f92-2e98-47df-b32d-d49e1d2f34c1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.689737] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-531d0f92-2e98-47df-b32d-d49e1d2f34c1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.689737] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.689737] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.689737] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.689737] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.689737] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.689737] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('531d0f92-2e98-47df-b32d-d49e1d2f34c1',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.689737] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-f169ad24-cb16-4605-bbb8-24c573c828c0 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.689737] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f169ad24-cb16-4605-bbb8-24c573c828c0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.691729] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f169ad24-cb16-4605-bbb8-24c573c828c0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.692166] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f169ad24-cb16-4605-bbb8-24c573c828c0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.692562] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f169ad24-cb16-4605-bbb8-24c573c828c0',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.762473] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.762625] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.762694] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.764632] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.764734] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.764991] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.765076] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.765125] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.765289] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.765363] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.765455] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa535b82-e1cd-4d4a-9994-f97b75b51d5e already deleted. [ 613.765532] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa535b82-e1cd-4d4a-9994-f97b75b51d5e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.195474] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('531d0f92-2e98-47df-b32d-d49e1d2f34c1',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.197877] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-531d0f92-2e98-47df-b32d-d49e1d2f34c1 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.197877] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-531d0f92-2e98-47df-b32d-d49e1d2f34c1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.198106] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f169ad24-cb16-4605-bbb8-24c573c828c0 with status ACTIVE [ 614.198216] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.198392] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.198500] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.198679] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.198786] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.202540] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.202540] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.202540] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.202540] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.202540] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.202540] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.202540] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.202540] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.202540] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.202540] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.202540] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f169ad24-cb16-4605-bbb8-24c573c828c0 is going to be updated. [ 614.228570] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.228887] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.228887] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.229240] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.229469] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.229712] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f169ad24-cb16-4605-bbb8-24c573c828c0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.295961] env[69232]: INFO networking_nsxv3.common.synchronization [None req-777b78a6-7c8e-4d32-bc9a-7f8236dbdec9 None None] Enqueued Resource ID: 0214f079-3fbe-4e26-ac36-3eea1cc472d4 with Priority: HIGHEST for action port [ 614.296659] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0214f079-3fbe-4e26-ac36-3eea1cc472d4 with Priority: HIGHEST for action port [ 614.297361] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-0214f079-3fbe-4e26-ac36-3eea1cc472d4 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.300356] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0214f079-3fbe-4e26-ac36-3eea1cc472d4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.300520] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0214f079-3fbe-4e26-ac36-3eea1cc472d4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.300737] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0214f079-3fbe-4e26-ac36-3eea1cc472d4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.300895] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0214f079-3fbe-4e26-ac36-3eea1cc472d4',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.700711] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock network-225 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.700711] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "network-225" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.700711] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "network-225" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.700711] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "network-225" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.702297] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.702680] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.706275] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.706578] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.706730] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.706949] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 614.707082] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] NeedRegenerationException {{(pid=69232) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 614.707188] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] no value, waiting for create lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 614.707292] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] value creation lock acquired {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 614.707396] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 614.707498] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Calling creation function for not-yet-present value {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 614.707645] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 614.709735] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('531d0f92-2e98-47df-b32d-d49e1d2f34c1',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.729966] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 614.732828] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=69232) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 614.732828] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Released creation lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 614.732828] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "network-225" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.732828] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock port-a562fa0e-9e2e-4883-91b4-cb165b2829d5 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.732828] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "port-a562fa0e-9e2e-4883-91b4-cb165b2829d5" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.732828] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "port-a562fa0e-9e2e-4883-91b4-cb165b2829d5" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.732828] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "port-a562fa0e-9e2e-4883-91b4-cb165b2829d5" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.732828] env[69232]: DEBUG networking_nsxv3.api.rpc [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a562fa0e-9e2e-4883-91b4-cb165b2829d5',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.805616] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0214f079-3fbe-4e26-ac36-3eea1cc472d4 [ 614.805616] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.807048] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.807048] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.807164] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.807224] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.807324] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0214f079-3fbe-4e26-ac36-3eea1cc472d4 already deleted. [ 614.807408] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0214f079-3fbe-4e26-ac36-3eea1cc472d4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.928358] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 04c8afd4-5b6b-40d6-827e-7916015a1e43 in Status: SUCCESS [ 614.928641] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-04c8afd4-5b6b-40d6-827e-7916015a1e43" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.213570] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.213936] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.213936] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.214058] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.214264] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.214338] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 531d0f92-2e98-47df-b32d-d49e1d2f34c1 is going to be created. [ 615.237732] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.239212] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.239212] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.239212] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.239212] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.239562] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Segment Port a562fa0e-9e2e-4883-91b4-cb165b2829d5 not found, creating... [ 615.239936] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.240886] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.241118] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.242478] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.242478] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.242478] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.242478] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.242478] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.243217] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.243465] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.243686] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Resource: SegmentPort with ID: a562fa0e-9e2e-4883-91b4-cb165b2829d5 is going to be created. [ 615.248717] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.249332] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.249515] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.249918] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.250437] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.271983] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 531d0f92-2e98-47df-b32d-d49e1d2f34c1 in Status: UNINITIALIZED for 2s [ 615.283748] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.283748] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.283748] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.286147] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.288155] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.288155] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "port-a562fa0e-9e2e-4883-91b4-cb165b2829d5" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.916697] env[69232]: INFO networking_nsxv3.common.synchronization [None req-a1433bb1-fb06-4691-9b6c-fa033cd8d87d None None] Enqueued Resource ID: 6b056c28-c5a9-4e92-ab41-3e686c60b426 with Priority: HIGHEST for action port [ 615.916952] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b056c28-c5a9-4e92-ab41-3e686c60b426 with Priority: HIGHEST for action port [ 615.917556] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-6b056c28-c5a9-4e92-ab41-3e686c60b426 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.917878] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6b056c28-c5a9-4e92-ab41-3e686c60b426" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.917878] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6b056c28-c5a9-4e92-ab41-3e686c60b426" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.918205] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6b056c28-c5a9-4e92-ab41-3e686c60b426" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.923277] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6b056c28-c5a9-4e92-ab41-3e686c60b426',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.968298] env[69232]: INFO networking_nsxv3.common.synchronization [req-4ad292a5-b566-451e-b8bd-9a7320207a10 req-1753988e-9419-4509-beb4-2a125010f13f tempest-FloatingIPsAssociationTestJSON-136976334 tempest-FloatingIPsAssociationTestJSON-136976334-project-member] Enqueued Resource ID: 5435d71f-3832-4f11-be57-bef3011dd7b7 with Priority: HIGHEST for action security_group_members [ 615.970630] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5435d71f-3832-4f11-be57-bef3011dd7b7 with Priority: HIGHEST for action security_group_members [ 615.970630] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-5435d71f-3832-4f11-be57-bef3011dd7b7 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.970630] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5435d71f-3832-4f11-be57-bef3011dd7b7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.970630] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5435d71f-3832-4f11-be57-bef3011dd7b7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.971989] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5435d71f-3832-4f11-be57-bef3011dd7b7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.971989] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.971989] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.971989] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.971989] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.971989] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.971989] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5435d71f-3832-4f11-be57-bef3011dd7b7',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.344403] env[69232]: INFO networking_nsxv3.common.synchronization [None req-1de3634c-b903-41d8-987a-ea6c0f9bbe25 None None] Enqueued Resource ID: 6c7bea78-794b-4cc5-b3aa-13c210570893 with Priority: HIGHEST for action port [ 616.345091] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c7bea78-794b-4cc5-b3aa-13c210570893 with Priority: HIGHEST for action port [ 616.345091] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-6c7bea78-794b-4cc5-b3aa-13c210570893 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.345230] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6c7bea78-794b-4cc5-b3aa-13c210570893" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.345269] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6c7bea78-794b-4cc5-b3aa-13c210570893" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.345536] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6c7bea78-794b-4cc5-b3aa-13c210570893" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.345619] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6c7bea78-794b-4cc5-b3aa-13c210570893',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.426747] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6b056c28-c5a9-4e92-ab41-3e686c60b426 [ 616.427048] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.427173] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.427665] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.427665] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.427863] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.427904] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6b056c28-c5a9-4e92-ab41-3e686c60b426 already deleted. [ 616.427989] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6b056c28-c5a9-4e92-ab41-3e686c60b426" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.475469] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.475731] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.475806] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.477371] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.477371] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.477371] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.477371] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.477371] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.477371] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.477371] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.477371] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5435d71f-3832-4f11-be57-bef3011dd7b7 already deleted. [ 616.477371] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5435d71f-3832-4f11-be57-bef3011dd7b7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.848277] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6c7bea78-794b-4cc5-b3aa-13c210570893 [ 616.848380] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.848695] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.848695] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.848863] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.848947] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.849052] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6c7bea78-794b-4cc5-b3aa-13c210570893 already deleted. [ 616.849141] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6c7bea78-794b-4cc5-b3aa-13c210570893" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.149030] env[69232]: INFO networking_nsxv3.common.synchronization [req-e35dc0f4-af3b-4cc3-a3af-f120a6a8ddfc req-fefc0e33-98a6-46f5-82a8-31ea2289e6df service nova] Enqueued Resource ID: aa535b82-e1cd-4d4a-9994-f97b75b51d5e with Priority: HIGHEST for action security_group_rules [ 617.149030] env[69232]: INFO networking_nsxv3.common.synchronization [req-e35dc0f4-af3b-4cc3-a3af-f120a6a8ddfc req-fefc0e33-98a6-46f5-82a8-31ea2289e6df service nova] Enqueued Resource ID: aa535b82-e1cd-4d4a-9994-f97b75b51d5e with Priority: HIGHEST for action security_group_members [ 617.149030] env[69232]: INFO networking_nsxv3.common.synchronization [req-e35dc0f4-af3b-4cc3-a3af-f120a6a8ddfc req-fefc0e33-98a6-46f5-82a8-31ea2289e6df service nova] Enqueued Resource ID: a562fa0e-9e2e-4883-91b4-cb165b2829d5 with Priority: HIGHEST for action port [ 617.149293] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa535b82-e1cd-4d4a-9994-f97b75b51d5e with Priority: HIGHEST for action security_group_rules [ 617.149293] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa535b82-e1cd-4d4a-9994-f97b75b51d5e with Priority: HIGHEST for action security_group_members [ 617.149359] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a562fa0e-9e2e-4883-91b4-cb165b2829d5 with Priority: HIGHEST for action port [ 617.149958] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aa535b82-e1cd-4d4a-9994-f97b75b51d5e taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.151514] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aa535b82-e1cd-4d4a-9994-f97b75b51d5e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.151514] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aa535b82-e1cd-4d4a-9994-f97b75b51d5e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.151712] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aa535b82-e1cd-4d4a-9994-f97b75b51d5e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.151925] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aa535b82-e1cd-4d4a-9994-f97b75b51d5e',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.153612] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa535b82-e1cd-4d4a-9994-f97b75b51d5e taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.153612] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa535b82-e1cd-4d4a-9994-f97b75b51d5e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.153612] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa535b82-e1cd-4d4a-9994-f97b75b51d5e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.153787] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa535b82-e1cd-4d4a-9994-f97b75b51d5e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.153787] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.155766] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.157226] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.157226] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.157226] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.157226] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa535b82-e1cd-4d4a-9994-f97b75b51d5e',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.158337] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-a562fa0e-9e2e-4883-91b4-cb165b2829d5 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.158337] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a562fa0e-9e2e-4883-91b4-cb165b2829d5" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.158337] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a562fa0e-9e2e-4883-91b4-cb165b2829d5" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.158337] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a562fa0e-9e2e-4883-91b4-cb165b2829d5" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.158653] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a562fa0e-9e2e-4883-91b4-cb165b2829d5',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.217500] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock network-105 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.217690] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "network-105" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.217815] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "network-105" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.218157] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "network-105" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.218503] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.218613] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.218714] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.218929] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.220909] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.221202] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 617.221328] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] NeedRegenerationException {{(pid=69232) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 617.221437] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] no value, waiting for create lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 617.221545] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] value creation lock acquired {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 617.221658] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 617.221765] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Calling creation function for not-yet-present value {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 617.221909] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 617.249204] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 617.249324] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=69232) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 617.249899] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Released creation lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 617.251085] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "network-105" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.251085] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock port-3035dd69-c8eb-4f8c-86bb-3f4585989785 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.251085] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "port-3035dd69-c8eb-4f8c-86bb-3f4585989785" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.251437] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "port-3035dd69-c8eb-4f8c-86bb-3f4585989785" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.253051] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "port-3035dd69-c8eb-4f8c-86bb-3f4585989785" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.253051] env[69232]: DEBUG networking_nsxv3.api.rpc [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3035dd69-c8eb-4f8c-86bb-3f4585989785',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.286209] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 531d0f92-2e98-47df-b32d-d49e1d2f34c1 in Status: SUCCESS [ 617.286209] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-531d0f92-2e98-47df-b32d-d49e1d2f34c1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.286209] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-531d0f92-2e98-47df-b32d-d49e1d2f34c1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.286209] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-531d0f92-2e98-47df-b32d-d49e1d2f34c1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.286209] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.286209] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.286209] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.286209] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.286209] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.286209] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-531d0f92-2e98-47df-b32d-d49e1d2f34c1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.286209] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('531d0f92-2e98-47df-b32d-d49e1d2f34c1',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.660472] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aa535b82-e1cd-4d4a-9994-f97b75b51d5e',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.662525] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa535b82-e1cd-4d4a-9994-f97b75b51d5e taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.662700] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa535b82-e1cd-4d4a-9994-f97b75b51d5e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.662932] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a562fa0e-9e2e-4883-91b4-cb165b2829d5 with status ACTIVE [ 617.663186] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.663352] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.663429] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.668824] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.668824] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.668824] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.668824] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.668824] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.669010] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.669039] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.669508] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.669508] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.669508] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.669736] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.669736] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.669811] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a562fa0e-9e2e-4883-91b4-cb165b2829d5 is going to be updated. [ 617.695456] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.695456] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.696017] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.696342] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.696676] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.696937] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a562fa0e-9e2e-4883-91b4-cb165b2829d5" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.759703] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.759944] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.760136] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.760473] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.760643] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.760915] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Segment Port 3035dd69-c8eb-4f8c-86bb-3f4585989785 not found, creating... [ 617.761251] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.761377] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.761431] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.761657] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.761850] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.762184] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.762436] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.762436] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.762655] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.762828] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.762929] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Resource: SegmentPort with ID: 3035dd69-c8eb-4f8c-86bb-3f4585989785 is going to be created. [ 617.790458] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-531d0f92-2e98-47df-b32d-d49e1d2f34c1 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.790657] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-531d0f92-2e98-47df-b32d-d49e1d2f34c1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.790705] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-531d0f92-2e98-47df-b32d-d49e1d2f34c1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.790890] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-531d0f92-2e98-47df-b32d-d49e1d2f34c1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.791060] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.791154] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.791213] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.791358] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.791439] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.791523] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-531d0f92-2e98-47df-b32d-d49e1d2f34c1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.791663] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-531d0f92-2e98-47df-b32d-d49e1d2f34c1 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.791777] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-531d0f92-2e98-47df-b32d-d49e1d2f34c1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.791808] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-531d0f92-2e98-47df-b32d-d49e1d2f34c1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.791927] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-531d0f92-2e98-47df-b32d-d49e1d2f34c1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.792068] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.793931] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.793931] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.793931] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.793931] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.793931] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-531d0f92-2e98-47df-b32d-d49e1d2f34c1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.793931] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('531d0f92-2e98-47df-b32d-d49e1d2f34c1',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.820405] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.820957] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.821253] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.821920] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.822301] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.823172] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "port-3035dd69-c8eb-4f8c-86bb-3f4585989785" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.903223] env[69232]: INFO networking_nsxv3.common.synchronization [None req-e232137b-805c-4f6f-84a3-5dff345ba884 None None] Enqueued Resource ID: d235bd2a-32a0-401f-bc6d-58748140f014 with Priority: HIGHEST for action port [ 617.903223] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d235bd2a-32a0-401f-bc6d-58748140f014 with Priority: HIGHEST for action port [ 617.903223] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-d235bd2a-32a0-401f-bc6d-58748140f014 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.903223] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d235bd2a-32a0-401f-bc6d-58748140f014" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.903223] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d235bd2a-32a0-401f-bc6d-58748140f014" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.903712] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d235bd2a-32a0-401f-bc6d-58748140f014" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.903909] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d235bd2a-32a0-401f-bc6d-58748140f014',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.172011] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aa535b82-e1cd-4d4a-9994-f97b75b51d5e',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.295901] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 531d0f92-2e98-47df-b32d-d49e1d2f34c1: rpc.has_security_group_logging(os_id): False [ 618.323841] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.323841] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.323841] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.323841] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.323841] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.323841] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.323841] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.323841] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.324498] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.324498] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.324498] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.324657] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.324657] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.324833] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.324909] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.325368] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.325515] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.325586] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.325743] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.325916] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.326366] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 531d0f92-2e98-47df-b32d-d49e1d2f34c1 is going to be created. [ 618.406580] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d235bd2a-32a0-401f-bc6d-58748140f014 [ 618.406817] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.406964] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.407064] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.409644] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.409644] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.409644] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d235bd2a-32a0-401f-bc6d-58748140f014 already deleted. [ 618.409644] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d235bd2a-32a0-401f-bc6d-58748140f014" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.420715] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.420885] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.420926] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.421150] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.421337] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.439974] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 531d0f92-2e98-47df-b32d-d49e1d2f34c1 in Status: IN_PROGRESS for 2s [ 618.675639] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.676127] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.676127] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.676127] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.677579] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.677579] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa535b82-e1cd-4d4a-9994-f97b75b51d5e is going to be created. [ 618.705868] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.706149] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.706149] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.706407] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.706708] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.717996] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa535b82-e1cd-4d4a-9994-f97b75b51d5e in Status: UNINITIALIZED for 2s [ 619.037318] env[69232]: INFO networking_nsxv3.common.synchronization [None req-3d29f531-97cb-4220-92fd-f2f141e1fda9 None None] Enqueued Resource ID: 21eb7c4c-94e8-487c-9d8a-d3bb70697df2 with Priority: HIGHEST for action port [ 619.037824] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21eb7c4c-94e8-487c-9d8a-d3bb70697df2 with Priority: HIGHEST for action port [ 619.038150] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-21eb7c4c-94e8-487c-9d8a-d3bb70697df2 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.038275] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-21eb7c4c-94e8-487c-9d8a-d3bb70697df2" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.038341] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-21eb7c4c-94e8-487c-9d8a-d3bb70697df2" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.038668] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-21eb7c4c-94e8-487c-9d8a-d3bb70697df2" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.038870] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('21eb7c4c-94e8-487c-9d8a-d3bb70697df2',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.282029] env[69232]: INFO networking_nsxv3.common.synchronization [req-cf9e9055-4a38-4c8a-a5a1-f65a62aa8075 req-edfe20a0-e4f2-4ccf-a86b-fea4c5600d40 tempest-FloatingIPsAssociationNegativeTestJSON-224180773 tempest-FloatingIPsAssociationNegativeTestJSON-224180773-project-member] Enqueued Resource ID: 4046c2da-b145-4a23-9fac-fd79697872c1 with Priority: HIGHEST for action security_group_members [ 619.282029] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4046c2da-b145-4a23-9fac-fd79697872c1 with Priority: HIGHEST for action security_group_members [ 619.282029] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-4046c2da-b145-4a23-9fac-fd79697872c1 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.282029] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4046c2da-b145-4a23-9fac-fd79697872c1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.282029] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4046c2da-b145-4a23-9fac-fd79697872c1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.282029] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4046c2da-b145-4a23-9fac-fd79697872c1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.282029] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.282029] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.282029] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.282731] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.282731] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.282731] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4046c2da-b145-4a23-9fac-fd79697872c1',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.540510] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 21eb7c4c-94e8-487c-9d8a-d3bb70697df2 [ 619.543543] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.543543] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.543543] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.543823] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.543823] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.543936] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:21eb7c4c-94e8-487c-9d8a-d3bb70697df2 already deleted. [ 619.543986] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-21eb7c4c-94e8-487c-9d8a-d3bb70697df2" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.787692] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.787692] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.787692] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.787692] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.787692] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.787692] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.787692] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.787692] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.787692] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.787692] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.787692] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4046c2da-b145-4a23-9fac-fd79697872c1 already deleted. [ 619.787692] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4046c2da-b145-4a23-9fac-fd79697872c1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.216210] env[69232]: INFO networking_nsxv3.common.synchronization [req-4ad292a5-b566-451e-b8bd-9a7320207a10 req-74b84b60-de17-466f-a9ff-8d313f3fe12c service nova] Enqueued Resource ID: 5435d71f-3832-4f11-be57-bef3011dd7b7 with Priority: HIGHEST for action security_group_rules [ 620.217242] env[69232]: INFO networking_nsxv3.common.synchronization [req-4ad292a5-b566-451e-b8bd-9a7320207a10 req-74b84b60-de17-466f-a9ff-8d313f3fe12c service nova] Enqueued Resource ID: 5435d71f-3832-4f11-be57-bef3011dd7b7 with Priority: HIGHEST for action security_group_members [ 620.217761] env[69232]: INFO networking_nsxv3.common.synchronization [req-4ad292a5-b566-451e-b8bd-9a7320207a10 req-74b84b60-de17-466f-a9ff-8d313f3fe12c service nova] Enqueued Resource ID: 3035dd69-c8eb-4f8c-86bb-3f4585989785 with Priority: HIGHEST for action port [ 620.218437] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5435d71f-3832-4f11-be57-bef3011dd7b7 with Priority: HIGHEST for action security_group_rules [ 620.218700] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5435d71f-3832-4f11-be57-bef3011dd7b7 with Priority: HIGHEST for action security_group_members [ 620.218884] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3035dd69-c8eb-4f8c-86bb-3f4585989785 with Priority: HIGHEST for action port [ 620.219121] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5435d71f-3832-4f11-be57-bef3011dd7b7 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.219293] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5435d71f-3832-4f11-be57-bef3011dd7b7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.219357] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5435d71f-3832-4f11-be57-bef3011dd7b7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.219585] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5435d71f-3832-4f11-be57-bef3011dd7b7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.219669] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5435d71f-3832-4f11-be57-bef3011dd7b7',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.220903] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-5435d71f-3832-4f11-be57-bef3011dd7b7 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.221044] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5435d71f-3832-4f11-be57-bef3011dd7b7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.221394] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5435d71f-3832-4f11-be57-bef3011dd7b7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.221394] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5435d71f-3832-4f11-be57-bef3011dd7b7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.221642] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.221757] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.221809] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.222121] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.222121] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.222204] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5435d71f-3832-4f11-be57-bef3011dd7b7',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.223245] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-3035dd69-c8eb-4f8c-86bb-3f4585989785 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.223833] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3035dd69-c8eb-4f8c-86bb-3f4585989785" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.223909] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3035dd69-c8eb-4f8c-86bb-3f4585989785" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.224116] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3035dd69-c8eb-4f8c-86bb-3f4585989785" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.224217] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3035dd69-c8eb-4f8c-86bb-3f4585989785',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.450819] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 531d0f92-2e98-47df-b32d-d49e1d2f34c1 in Status: SUCCESS [ 620.451040] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-531d0f92-2e98-47df-b32d-d49e1d2f34c1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.510316] env[69232]: INFO networking_nsxv3.common.synchronization [None req-001b35bd-ce9f-4dbf-945d-e27d2a71e3d1 tempest-AttachInterfacesTestJSON-1442903876 tempest-AttachInterfacesTestJSON-1442903876-project-member] Enqueued Resource ID: 36cbe3ea-321a-4c5f-b46b-f3297d4ccb49 with Priority: HIGHEST for action security_group_rules [ 620.510828] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 36cbe3ea-321a-4c5f-b46b-f3297d4ccb49 with Priority: HIGHEST for action security_group_rules [ 620.511987] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-36cbe3ea-321a-4c5f-b46b-f3297d4ccb49 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.512562] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-36cbe3ea-321a-4c5f-b46b-f3297d4ccb49" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.512795] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-36cbe3ea-321a-4c5f-b46b-f3297d4ccb49" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.512913] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-36cbe3ea-321a-4c5f-b46b-f3297d4ccb49" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.513368] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('36cbe3ea-321a-4c5f-b46b-f3297d4ccb49',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.705802] env[69232]: INFO networking_nsxv3.common.synchronization [None req-106427ce-513d-4f2c-bffc-58e46a78535d None None] Enqueued Resource ID: 1e94c6fe-358d-4074-91c2-223e30b9a905 with Priority: HIGHEST for action port [ 620.707457] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e94c6fe-358d-4074-91c2-223e30b9a905 with Priority: HIGHEST for action port [ 620.707854] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-1e94c6fe-358d-4074-91c2-223e30b9a905 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.708090] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1e94c6fe-358d-4074-91c2-223e30b9a905" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.708146] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1e94c6fe-358d-4074-91c2-223e30b9a905" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.709508] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1e94c6fe-358d-4074-91c2-223e30b9a905" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.709666] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1e94c6fe-358d-4074-91c2-223e30b9a905',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.727082] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-5435d71f-3832-4f11-be57-bef3011dd7b7 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.727265] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5435d71f-3832-4f11-be57-bef3011dd7b7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.727403] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5435d71f-3832-4f11-be57-bef3011dd7b7',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.728387] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3035dd69-c8eb-4f8c-86bb-3f4585989785 with status ACTIVE [ 620.728487] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.728594] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.728660] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.728865] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.728947] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.729129] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.729235] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.729293] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.729443] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.729524] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.729696] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.729783] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.729839] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.729975] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.730062] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.730160] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3035dd69-c8eb-4f8c-86bb-3f4585989785 is going to be updated. [ 620.732330] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa535b82-e1cd-4d4a-9994-f97b75b51d5e in Status: SUCCESS [ 620.732495] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa535b82-e1cd-4d4a-9994-f97b75b51d5e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.732837] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa535b82-e1cd-4d4a-9994-f97b75b51d5e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.733012] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa535b82-e1cd-4d4a-9994-f97b75b51d5e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.733194] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.733293] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.733354] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.734083] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.734171] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.734259] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa535b82-e1cd-4d4a-9994-f97b75b51d5e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.734349] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('aa535b82-e1cd-4d4a-9994-f97b75b51d5e',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.758371] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.758569] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.758649] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.758958] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.759164] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.759358] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3035dd69-c8eb-4f8c-86bb-3f4585989785" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.775644] env[69232]: INFO networking_nsxv3.common.synchronization [None req-a2de5590-e69e-4f4b-8aa7-fbb6607cd66d tempest-AttachInterfacesTestJSON-1442903876 tempest-AttachInterfacesTestJSON-1442903876-project-member] Enqueued Resource ID: 36cbe3ea-321a-4c5f-b46b-f3297d4ccb49 with Priority: HIGHEST for action security_group_rules [ 620.777370] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 36cbe3ea-321a-4c5f-b46b-f3297d4ccb49 with Priority: HIGHEST for action security_group_rules [ 620.777723] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-36cbe3ea-321a-4c5f-b46b-f3297d4ccb49 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.777825] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-36cbe3ea-321a-4c5f-b46b-f3297d4ccb49" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.043150] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.043711] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.043903] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.045078] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.045297] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.045986] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 36cbe3ea-321a-4c5f-b46b-f3297d4ccb49 already deleted. [ 621.046219] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-36cbe3ea-321a-4c5f-b46b-f3297d4ccb49" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.046839] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-36cbe3ea-321a-4c5f-b46b-f3297d4ccb49" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.047146] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-36cbe3ea-321a-4c5f-b46b-f3297d4ccb49" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.047318] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('36cbe3ea-321a-4c5f-b46b-f3297d4ccb49',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.147214] env[69232]: INFO networking_nsxv3.common.synchronization [req-8bc2e549-b06d-4ea4-9d0c-4fc08441b6e3 req-017d4216-6b3e-4f02-93ae-f78b6a9559b5 tempest-ServerExternalEventsTest-756365759 tempest-ServerExternalEventsTest-756365759-project-member] Enqueued Resource ID: 59f751d0-35f1-46f2-bae9-2c23df6749c4 with Priority: HIGHEST for action security_group_members [ 621.149950] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 59f751d0-35f1-46f2-bae9-2c23df6749c4 with Priority: HIGHEST for action security_group_members [ 621.150333] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-59f751d0-35f1-46f2-bae9-2c23df6749c4 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.150333] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-59f751d0-35f1-46f2-bae9-2c23df6749c4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.150532] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-59f751d0-35f1-46f2-bae9-2c23df6749c4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.150830] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-59f751d0-35f1-46f2-bae9-2c23df6749c4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.150948] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.151957] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.151957] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.151957] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.151957] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.151957] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('59f751d0-35f1-46f2-bae9-2c23df6749c4',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.212679] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1e94c6fe-358d-4074-91c2-223e30b9a905 [ 621.212679] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.212679] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.212679] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.212878] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.213656] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.213656] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1e94c6fe-358d-4074-91c2-223e30b9a905 already deleted. [ 621.213656] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1e94c6fe-358d-4074-91c2-223e30b9a905" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.233687] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5435d71f-3832-4f11-be57-bef3011dd7b7',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.237581] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa535b82-e1cd-4d4a-9994-f97b75b51d5e taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.237581] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa535b82-e1cd-4d4a-9994-f97b75b51d5e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.237581] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa535b82-e1cd-4d4a-9994-f97b75b51d5e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.237581] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa535b82-e1cd-4d4a-9994-f97b75b51d5e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.237581] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.237581] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.237581] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.237581] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.237581] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.237581] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa535b82-e1cd-4d4a-9994-f97b75b51d5e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.237581] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa535b82-e1cd-4d4a-9994-f97b75b51d5e taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.237581] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa535b82-e1cd-4d4a-9994-f97b75b51d5e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.239209] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa535b82-e1cd-4d4a-9994-f97b75b51d5e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.239209] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa535b82-e1cd-4d4a-9994-f97b75b51d5e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.239209] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.239209] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.239209] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.239209] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.239209] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.239209] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa535b82-e1cd-4d4a-9994-f97b75b51d5e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.239209] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('aa535b82-e1cd-4d4a-9994-f97b75b51d5e',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.577685] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.577857] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.577857] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.578057] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.578148] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.578734] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 36cbe3ea-321a-4c5f-b46b-f3297d4ccb49 already deleted. [ 621.578734] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-36cbe3ea-321a-4c5f-b46b-f3297d4ccb49" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.654463] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.654670] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.654748] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.656138] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.656381] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.656622] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.656740] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.656807] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.657007] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.657098] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.657190] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 59f751d0-35f1-46f2-bae9-2c23df6749c4 already deleted. [ 621.657272] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-59f751d0-35f1-46f2-bae9-2c23df6749c4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.737549] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.737946] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.737946] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.737946] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.738301] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.738301] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5435d71f-3832-4f11-be57-bef3011dd7b7 is going to be created. [ 621.740500] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for aa535b82-e1cd-4d4a-9994-f97b75b51d5e: rpc.has_security_group_logging(os_id): False [ 621.751048] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock network-775 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.751254] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "network-775" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.751374] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "network-775" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.751695] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "network-775" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.753016] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.753016] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.753016] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.753016] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.753016] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.753016] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 621.753016] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] NeedRegenerationException {{(pid=69232) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 621.753016] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] no value, waiting for create lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 621.753323] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] value creation lock acquired {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 621.753521] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 621.753565] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Calling creation function for not-yet-present value {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 621.753760] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 621.763229] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.763367] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.763429] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.763668] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.763734] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.763915] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.764026] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.764091] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.764247] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.765303] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.765581] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.765786] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.765850] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.766058] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.766146] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.766366] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.766468] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.766531] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.766726] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.766812] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.766900] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aa535b82-e1cd-4d4a-9994-f97b75b51d5e is going to be created. [ 621.768772] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.768888] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.768959] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.769127] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.769271] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.783332] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 621.783332] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=69232) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 621.784049] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Released creation lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 621.784049] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "network-775" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.784049] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock port-b2dfa457-75a8-4af6-9a6b-41130b9a0c44 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.784359] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "port-b2dfa457-75a8-4af6-9a6b-41130b9a0c44" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.784481] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "port-b2dfa457-75a8-4af6-9a6b-41130b9a0c44" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.785036] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "port-b2dfa457-75a8-4af6-9a6b-41130b9a0c44" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.785212] env[69232]: DEBUG networking_nsxv3.api.rpc [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b2dfa457-75a8-4af6-9a6b-41130b9a0c44',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.786862] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5435d71f-3832-4f11-be57-bef3011dd7b7 in Status: UNINITIALIZED for 2s [ 621.852249] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.852427] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.852493] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.853794] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.854357] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.868102] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aa535b82-e1cd-4d4a-9994-f97b75b51d5e in Status: IN_PROGRESS for 2s [ 622.288731] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.289271] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.289271] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.289657] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.289657] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.289793] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Segment Port b2dfa457-75a8-4af6-9a6b-41130b9a0c44 not found, creating... [ 622.290084] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.290439] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.290527] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.290943] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.291152] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.291369] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.291671] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.291671] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.292150] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.292315] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.292513] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Resource: SegmentPort with ID: b2dfa457-75a8-4af6-9a6b-41130b9a0c44 is going to be created. [ 622.318214] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.318557] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.318557] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.318986] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.319111] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.319306] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "port-b2dfa457-75a8-4af6-9a6b-41130b9a0c44" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.449728] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock network-225 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.449728] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "network-225" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.449728] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "network-225" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.451084] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "network-225" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.451084] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.451084] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.451084] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.451328] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.451488] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.451932] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 623.452092] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] NeedRegenerationException {{(pid=69232) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 623.452206] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] no value, waiting for create lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 623.452316] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] value creation lock acquired {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 623.452471] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 623.452599] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Calling creation function for not-yet-present value {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 623.452740] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 623.477068] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 623.477068] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69232) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 623.477068] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Released creation lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 623.477068] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "network-225" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.477068] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock port-17723506-f4df-4fe9-abef-23d187f43713 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.477774] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "port-17723506-f4df-4fe9-abef-23d187f43713" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.477915] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "port-17723506-f4df-4fe9-abef-23d187f43713" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.478333] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "port-17723506-f4df-4fe9-abef-23d187f43713" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.478489] env[69232]: DEBUG networking_nsxv3.api.rpc [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('17723506-f4df-4fe9-abef-23d187f43713',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.632635] env[69232]: INFO networking_nsxv3.common.synchronization [None req-45e75b53-92a6-43c1-a65b-90916becd415 None None] Enqueued Resource ID: 48dad05e-e3d3-4280-a9f4-0c5ba41439bc with Priority: HIGHEST for action port [ 623.634354] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48dad05e-e3d3-4280-a9f4-0c5ba41439bc with Priority: HIGHEST for action port [ 623.634810] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-48dad05e-e3d3-4280-a9f4-0c5ba41439bc taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.635025] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-48dad05e-e3d3-4280-a9f4-0c5ba41439bc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.635131] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-48dad05e-e3d3-4280-a9f4-0c5ba41439bc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.635503] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-48dad05e-e3d3-4280-a9f4-0c5ba41439bc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.635622] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('48dad05e-e3d3-4280-a9f4-0c5ba41439bc',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.730625] env[69232]: INFO networking_nsxv3.common.synchronization [None req-731c2b0e-1baf-4f43-9046-850b560e1342 None None] Enqueued Resource ID: 283c91ba-a886-4cce-aed1-0ab463915f72 with Priority: HIGHEST for action port [ 623.731242] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 283c91ba-a886-4cce-aed1-0ab463915f72 with Priority: HIGHEST for action port [ 623.731542] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-283c91ba-a886-4cce-aed1-0ab463915f72 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.735169] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-283c91ba-a886-4cce-aed1-0ab463915f72" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.735169] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-283c91ba-a886-4cce-aed1-0ab463915f72" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.735169] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-283c91ba-a886-4cce-aed1-0ab463915f72" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.735169] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('283c91ba-a886-4cce-aed1-0ab463915f72',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.800624] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5435d71f-3832-4f11-be57-bef3011dd7b7 in Status: SUCCESS [ 623.801093] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5435d71f-3832-4f11-be57-bef3011dd7b7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.801746] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5435d71f-3832-4f11-be57-bef3011dd7b7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.801979] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5435d71f-3832-4f11-be57-bef3011dd7b7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.802206] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.802329] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.802393] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.802603] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.804084] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.804450] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5435d71f-3832-4f11-be57-bef3011dd7b7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.804935] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5435d71f-3832-4f11-be57-bef3011dd7b7',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.882427] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aa535b82-e1cd-4d4a-9994-f97b75b51d5e in Status: SUCCESS [ 623.883128] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aa535b82-e1cd-4d4a-9994-f97b75b51d5e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.981789] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.985146] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.985146] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.985146] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.985146] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.985146] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Segment Port 17723506-f4df-4fe9-abef-23d187f43713 not found, creating... [ 623.985146] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.985146] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.985146] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.985146] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.985146] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.985981] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.985981] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.986133] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.986538] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.986538] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.986715] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Resource: SegmentPort with ID: 17723506-f4df-4fe9-abef-23d187f43713 is going to be created. [ 624.009747] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.010028] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.010028] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.010401] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.011094] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.011094] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "port-17723506-f4df-4fe9-abef-23d187f43713" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.141162] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 48dad05e-e3d3-4280-a9f4-0c5ba41439bc [ 624.141162] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.141605] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.141605] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.143033] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.143467] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.143467] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:48dad05e-e3d3-4280-a9f4-0c5ba41439bc already deleted. [ 624.143467] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-48dad05e-e3d3-4280-a9f4-0c5ba41439bc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.236352] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 283c91ba-a886-4cce-aed1-0ab463915f72 [ 624.236602] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.237243] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.237521] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.237931] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.238125] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.238364] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:283c91ba-a886-4cce-aed1-0ab463915f72 already deleted. [ 624.239113] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-283c91ba-a886-4cce-aed1-0ab463915f72" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.308026] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-5435d71f-3832-4f11-be57-bef3011dd7b7 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.308892] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5435d71f-3832-4f11-be57-bef3011dd7b7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.308892] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5435d71f-3832-4f11-be57-bef3011dd7b7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.308892] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5435d71f-3832-4f11-be57-bef3011dd7b7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.310911] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.310911] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.310911] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.310911] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.310911] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.310911] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5435d71f-3832-4f11-be57-bef3011dd7b7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.311565] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-5435d71f-3832-4f11-be57-bef3011dd7b7 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.312235] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5435d71f-3832-4f11-be57-bef3011dd7b7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.312235] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5435d71f-3832-4f11-be57-bef3011dd7b7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.312235] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5435d71f-3832-4f11-be57-bef3011dd7b7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.312434] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.312550] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.312680] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.312821] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.312928] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.313257] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5435d71f-3832-4f11-be57-bef3011dd7b7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.313695] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5435d71f-3832-4f11-be57-bef3011dd7b7',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.348913] env[69232]: INFO networking_nsxv3.common.synchronization [req-ed12d5f0-6ca0-440c-8ffc-2772171dbd94 req-95ff2968-ed5a-4f1e-9324-ae5be5e98c5d tempest-DeleteServersAdminTestJSON-414290130 tempest-DeleteServersAdminTestJSON-414290130-project-admin] Enqueued Resource ID: 04c8afd4-5b6b-40d6-827e-7916015a1e43 with Priority: HIGHEST for action security_group_members [ 624.350714] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04c8afd4-5b6b-40d6-827e-7916015a1e43 with Priority: HIGHEST for action security_group_members [ 624.351122] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-04c8afd4-5b6b-40d6-827e-7916015a1e43 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.351281] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04c8afd4-5b6b-40d6-827e-7916015a1e43" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.351347] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04c8afd4-5b6b-40d6-827e-7916015a1e43" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.351650] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04c8afd4-5b6b-40d6-827e-7916015a1e43" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.351760] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.351975] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.351975] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.352130] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.352189] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.352592] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('04c8afd4-5b6b-40d6-827e-7916015a1e43',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.580445] env[69232]: INFO networking_nsxv3.common.synchronization [req-2056b5a5-18d5-4755-872f-f932f75cc8da req-c0aafb50-2e77-4722-b205-fd727bd19432 tempest-ServersTestJSON-1956507718 tempest-ServersTestJSON-1956507718-project-member] Enqueued Resource ID: 21513cb2-4b6e-4c9f-864c-d3d144ce0d57 with Priority: HIGHEST for action security_group_members [ 624.581786] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21513cb2-4b6e-4c9f-864c-d3d144ce0d57 with Priority: HIGHEST for action security_group_members [ 624.581786] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-21513cb2-4b6e-4c9f-864c-d3d144ce0d57 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.581786] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21513cb2-4b6e-4c9f-864c-d3d144ce0d57" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.581786] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21513cb2-4b6e-4c9f-864c-d3d144ce0d57" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.581786] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21513cb2-4b6e-4c9f-864c-d3d144ce0d57" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.582089] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.582089] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.582089] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.583641] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.583767] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.583873] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('21513cb2-4b6e-4c9f-864c-d3d144ce0d57',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.713124] env[69232]: INFO networking_nsxv3.common.synchronization [None req-ec2cd387-ebe1-4ce6-b037-7a08b6594e12 None None] Enqueued Resource ID: b1510817-1086-4fe3-bdf5-5ae913d3b574 with Priority: HIGHEST for action port [ 624.714269] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1510817-1086-4fe3-bdf5-5ae913d3b574 with Priority: HIGHEST for action port [ 624.717112] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-b1510817-1086-4fe3-bdf5-5ae913d3b574 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.717112] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b1510817-1086-4fe3-bdf5-5ae913d3b574" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.717112] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b1510817-1086-4fe3-bdf5-5ae913d3b574" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.717239] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b1510817-1086-4fe3-bdf5-5ae913d3b574" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.717239] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b1510817-1086-4fe3-bdf5-5ae913d3b574',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.818368] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5435d71f-3832-4f11-be57-bef3011dd7b7: rpc.has_security_group_logging(os_id): False [ 624.838896] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.838896] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.838896] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.838896] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.838896] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.838896] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.838896] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.838896] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.838896] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.838896] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.840182] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.840182] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.840182] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.840182] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.840182] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.840182] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.840182] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.840182] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.840697] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.840697] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.840697] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5435d71f-3832-4f11-be57-bef3011dd7b7 is going to be created. [ 624.857723] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.857939] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.858024] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.858252] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.859180] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.859579] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.859778] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.859888] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.860148] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.861056] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.861056] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 04c8afd4-5b6b-40d6-827e-7916015a1e43 is going to be updated. [ 624.870419] env[69232]: INFO networking_nsxv3.common.synchronization [req-cf9e9055-4a38-4c8a-a5a1-f65a62aa8075 req-47a32fc6-b47c-40f4-88fe-a041dd0154d0 service nova] Enqueued Resource ID: 4046c2da-b145-4a23-9fac-fd79697872c1 with Priority: HIGHEST for action security_group_rules [ 624.870663] env[69232]: INFO networking_nsxv3.common.synchronization [req-cf9e9055-4a38-4c8a-a5a1-f65a62aa8075 req-47a32fc6-b47c-40f4-88fe-a041dd0154d0 service nova] Enqueued Resource ID: 4046c2da-b145-4a23-9fac-fd79697872c1 with Priority: HIGHEST for action security_group_members [ 624.870745] env[69232]: INFO networking_nsxv3.common.synchronization [req-cf9e9055-4a38-4c8a-a5a1-f65a62aa8075 req-47a32fc6-b47c-40f4-88fe-a041dd0154d0 service nova] Enqueued Resource ID: b2dfa457-75a8-4af6-9a6b-41130b9a0c44 with Priority: HIGHEST for action port [ 624.871325] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4046c2da-b145-4a23-9fac-fd79697872c1 with Priority: HIGHEST for action security_group_rules [ 624.871605] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4046c2da-b145-4a23-9fac-fd79697872c1 with Priority: HIGHEST for action security_group_members [ 624.871605] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b2dfa457-75a8-4af6-9a6b-41130b9a0c44 with Priority: HIGHEST for action port [ 624.871974] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4046c2da-b145-4a23-9fac-fd79697872c1 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.871974] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4046c2da-b145-4a23-9fac-fd79697872c1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.872214] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4046c2da-b145-4a23-9fac-fd79697872c1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.872277] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4046c2da-b145-4a23-9fac-fd79697872c1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.872362] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4046c2da-b145-4a23-9fac-fd79697872c1',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.873232] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-4046c2da-b145-4a23-9fac-fd79697872c1 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.873360] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4046c2da-b145-4a23-9fac-fd79697872c1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.873413] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4046c2da-b145-4a23-9fac-fd79697872c1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.873596] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4046c2da-b145-4a23-9fac-fd79697872c1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.873748] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.873847] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.873906] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.874114] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.874339] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.874339] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4046c2da-b145-4a23-9fac-fd79697872c1',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.875066] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-b2dfa457-75a8-4af6-9a6b-41130b9a0c44 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.875243] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b2dfa457-75a8-4af6-9a6b-41130b9a0c44" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.875243] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b2dfa457-75a8-4af6-9a6b-41130b9a0c44" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.875457] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b2dfa457-75a8-4af6-9a6b-41130b9a0c44" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.875457] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b2dfa457-75a8-4af6-9a6b-41130b9a0c44',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.897033] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.897033] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.897033] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.897033] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.897482] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.908202] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.908344] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.908413] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.908670] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.908851] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.913663] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 04c8afd4-5b6b-40d6-827e-7916015a1e43 in Status: IN_PROGRESS for 2s [ 624.924867] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5435d71f-3832-4f11-be57-bef3011dd7b7 in Status: IN_PROGRESS for 2s [ 625.070590] env[69232]: INFO networking_nsxv3.common.synchronization [None req-1d66538a-de88-4f99-aee2-5477b9cbd0d2 None None] Enqueued Resource ID: 0b1c90bd-8c20-430f-997b-f75808de3fe1 with Priority: HIGHEST for action port [ 625.073267] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b1c90bd-8c20-430f-997b-f75808de3fe1 with Priority: HIGHEST for action port [ 625.073824] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-0b1c90bd-8c20-430f-997b-f75808de3fe1 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.074027] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0b1c90bd-8c20-430f-997b-f75808de3fe1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.074125] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0b1c90bd-8c20-430f-997b-f75808de3fe1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.074503] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0b1c90bd-8c20-430f-997b-f75808de3fe1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.074681] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0b1c90bd-8c20-430f-997b-f75808de3fe1',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.090914] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.090914] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.090914] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.091398] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.091398] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.091398] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.091552] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.091637] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.091890] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.092030] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.092159] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 21513cb2-4b6e-4c9f-864c-d3d144ce0d57 already deleted. [ 625.092276] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21513cb2-4b6e-4c9f-864c-d3d144ce0d57" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.220234] env[69232]: INFO networking_nsxv3.common.synchronization [None req-14848b70-fab3-4036-996f-47c3efb6e59a None None] Enqueued Resource ID: 5b9b185a-3f5a-463a-b2e5-d33c53408024 with Priority: HIGHEST for action port [ 625.220990] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b1510817-1086-4fe3-bdf5-5ae913d3b574 [ 625.221265] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.221608] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.221608] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.221712] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.221892] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.222015] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b1510817-1086-4fe3-bdf5-5ae913d3b574 already deleted. [ 625.222207] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b1510817-1086-4fe3-bdf5-5ae913d3b574" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.222704] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b9b185a-3f5a-463a-b2e5-d33c53408024 with Priority: HIGHEST for action port [ 625.223115] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-5b9b185a-3f5a-463a-b2e5-d33c53408024 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.223291] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5b9b185a-3f5a-463a-b2e5-d33c53408024" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.223291] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5b9b185a-3f5a-463a-b2e5-d33c53408024" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.223540] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5b9b185a-3f5a-463a-b2e5-d33c53408024" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.223765] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5b9b185a-3f5a-463a-b2e5-d33c53408024',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.377925] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4046c2da-b145-4a23-9fac-fd79697872c1',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.380495] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-4046c2da-b145-4a23-9fac-fd79697872c1 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.383846] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4046c2da-b145-4a23-9fac-fd79697872c1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.383846] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b2dfa457-75a8-4af6-9a6b-41130b9a0c44 with status ACTIVE [ 625.383846] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.383846] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.383846] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.383846] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.383846] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.383846] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.383846] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.383846] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.383846] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.383846] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.383846] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.383846] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.383846] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.383846] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.383846] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.384561] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b2dfa457-75a8-4af6-9a6b-41130b9a0c44 is going to be updated. [ 625.405503] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.405503] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.405503] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.405752] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.405972] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.406222] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b2dfa457-75a8-4af6-9a6b-41130b9a0c44" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.577903] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0b1c90bd-8c20-430f-997b-f75808de3fe1 [ 625.578335] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.578635] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.578820] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.579159] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.579344] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.579575] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0b1c90bd-8c20-430f-997b-f75808de3fe1 already deleted. [ 625.579773] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0b1c90bd-8c20-430f-997b-f75808de3fe1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.728735] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5b9b185a-3f5a-463a-b2e5-d33c53408024 [ 625.730763] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.730763] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.730763] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.730763] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.730763] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.730763] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5b9b185a-3f5a-463a-b2e5-d33c53408024 already deleted. [ 625.730763] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5b9b185a-3f5a-463a-b2e5-d33c53408024" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.780449] env[69232]: INFO networking_nsxv3.common.synchronization [None req-f107d821-82ae-4b25-b20f-2ed6fd797a83 tempest-ServersTestBootFromVolume-980609594 tempest-ServersTestBootFromVolume-980609594-project-member] Enqueued Resource ID: 45780cba-cd94-4a19-b7a8-aa324fdcb9c5 with Priority: HIGHEST for action security_group_rules [ 625.782098] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45780cba-cd94-4a19-b7a8-aa324fdcb9c5 with Priority: HIGHEST for action security_group_rules [ 625.782476] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-45780cba-cd94-4a19-b7a8-aa324fdcb9c5 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.782648] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-45780cba-cd94-4a19-b7a8-aa324fdcb9c5" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.783084] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-45780cba-cd94-4a19-b7a8-aa324fdcb9c5" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.783387] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-45780cba-cd94-4a19-b7a8-aa324fdcb9c5" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.783562] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('45780cba-cd94-4a19-b7a8-aa324fdcb9c5',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.887215] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4046c2da-b145-4a23-9fac-fd79697872c1',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.308131] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.308332] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.308446] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.308886] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.308886] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.309041] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 45780cba-cd94-4a19-b7a8-aa324fdcb9c5 already deleted. [ 626.309041] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-45780cba-cd94-4a19-b7a8-aa324fdcb9c5" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.395028] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.395028] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.395028] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.395028] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.395028] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.395028] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4046c2da-b145-4a23-9fac-fd79697872c1 is going to be created. [ 626.429946] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.429946] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.429946] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.429946] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.429946] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.443599] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4046c2da-b145-4a23-9fac-fd79697872c1 in Status: UNINITIALIZED for 2s [ 626.638760] env[69232]: INFO networking_nsxv3.common.synchronization [req-8bc2e549-b06d-4ea4-9d0c-4fc08441b6e3 req-808d9b92-19df-4daf-9eba-6e271ebe72cc service nova] Enqueued Resource ID: 59f751d0-35f1-46f2-bae9-2c23df6749c4 with Priority: HIGHEST for action security_group_rules [ 626.638942] env[69232]: INFO networking_nsxv3.common.synchronization [req-8bc2e549-b06d-4ea4-9d0c-4fc08441b6e3 req-808d9b92-19df-4daf-9eba-6e271ebe72cc service nova] Enqueued Resource ID: 59f751d0-35f1-46f2-bae9-2c23df6749c4 with Priority: HIGHEST for action security_group_members [ 626.640990] env[69232]: INFO networking_nsxv3.common.synchronization [req-8bc2e549-b06d-4ea4-9d0c-4fc08441b6e3 req-808d9b92-19df-4daf-9eba-6e271ebe72cc service nova] Enqueued Resource ID: 17723506-f4df-4fe9-abef-23d187f43713 with Priority: HIGHEST for action port [ 626.640990] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 59f751d0-35f1-46f2-bae9-2c23df6749c4 with Priority: HIGHEST for action security_group_rules [ 626.641122] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 59f751d0-35f1-46f2-bae9-2c23df6749c4 with Priority: HIGHEST for action security_group_members [ 626.641209] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17723506-f4df-4fe9-abef-23d187f43713 with Priority: HIGHEST for action port [ 626.641711] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-59f751d0-35f1-46f2-bae9-2c23df6749c4 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.641901] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-59f751d0-35f1-46f2-bae9-2c23df6749c4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.641901] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-59f751d0-35f1-46f2-bae9-2c23df6749c4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.642157] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-59f751d0-35f1-46f2-bae9-2c23df6749c4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.642235] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('59f751d0-35f1-46f2-bae9-2c23df6749c4',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.643894] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-59f751d0-35f1-46f2-bae9-2c23df6749c4 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.644227] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-59f751d0-35f1-46f2-bae9-2c23df6749c4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.644227] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-59f751d0-35f1-46f2-bae9-2c23df6749c4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.644328] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-59f751d0-35f1-46f2-bae9-2c23df6749c4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.644390] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.644480] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.644538] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.644675] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.644753] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.644877] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('59f751d0-35f1-46f2-bae9-2c23df6749c4',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.645579] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-17723506-f4df-4fe9-abef-23d187f43713 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.645677] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-17723506-f4df-4fe9-abef-23d187f43713" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.645794] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-17723506-f4df-4fe9-abef-23d187f43713" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.647095] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-17723506-f4df-4fe9-abef-23d187f43713" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.647095] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('17723506-f4df-4fe9-abef-23d187f43713',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.681464] env[69232]: INFO networking_nsxv3.common.synchronization [None req-ef9ff54a-df66-4608-9462-b7e04dba6c80 tempest-ServersTestBootFromVolume-980609594 tempest-ServersTestBootFromVolume-980609594-project-member] Enqueued Resource ID: 45780cba-cd94-4a19-b7a8-aa324fdcb9c5 with Priority: HIGHEST for action security_group_rules [ 626.682457] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45780cba-cd94-4a19-b7a8-aa324fdcb9c5 with Priority: HIGHEST for action security_group_rules [ 626.682457] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-45780cba-cd94-4a19-b7a8-aa324fdcb9c5 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.682606] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-45780cba-cd94-4a19-b7a8-aa324fdcb9c5" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.682637] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-45780cba-cd94-4a19-b7a8-aa324fdcb9c5" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.683758] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-45780cba-cd94-4a19-b7a8-aa324fdcb9c5" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.683758] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('45780cba-cd94-4a19-b7a8-aa324fdcb9c5',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.829483] env[69232]: INFO networking_nsxv3.common.synchronization [req-3360cd82-1ee4-4a68-bc20-ba3db939841d req-27b04a62-5282-4da6-8cbe-24b9be35a017 tempest-VolumesAssistedSnapshotsTest-1395395803 tempest-VolumesAssistedSnapshotsTest-1395395803-project-member] Enqueued Resource ID: c042e2fd-851d-4970-9cfd-994d6fa3bc3a with Priority: HIGHEST for action security_group_members [ 626.830415] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c042e2fd-851d-4970-9cfd-994d6fa3bc3a with Priority: HIGHEST for action security_group_members [ 626.830541] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-c042e2fd-851d-4970-9cfd-994d6fa3bc3a taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.830629] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c042e2fd-851d-4970-9cfd-994d6fa3bc3a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.830629] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c042e2fd-851d-4970-9cfd-994d6fa3bc3a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.830869] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c042e2fd-851d-4970-9cfd-994d6fa3bc3a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.831027] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.831125] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.831182] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.831334] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.831414] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.832019] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c042e2fd-851d-4970-9cfd-994d6fa3bc3a',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.924143] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 04c8afd4-5b6b-40d6-827e-7916015a1e43 in Status: SUCCESS [ 626.924339] env[69232]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 04c8afd4-5b6b-40d6-827e-7916015a1e43 deletion is rescheduled due to dependency. [ 626.924459] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04c8afd4-5b6b-40d6-827e-7916015a1e43" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.939547] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5435d71f-3832-4f11-be57-bef3011dd7b7 in Status: SUCCESS [ 626.939547] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5435d71f-3832-4f11-be57-bef3011dd7b7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.149933] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-59f751d0-35f1-46f2-bae9-2c23df6749c4 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.150135] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-59f751d0-35f1-46f2-bae9-2c23df6749c4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.151527] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('59f751d0-35f1-46f2-bae9-2c23df6749c4',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.151527] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 17723506-f4df-4fe9-abef-23d187f43713 with status ACTIVE [ 627.151527] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.151875] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.151875] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.151875] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.151962] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.152172] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.152247] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.152247] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.156435] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.156707] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.157064] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.159227] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.159227] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.159227] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.159227] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.159227] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 17723506-f4df-4fe9-abef-23d187f43713 is going to be updated. [ 627.196613] env[69232]: INFO networking_nsxv3.common.synchronization [None req-1101f0dd-40fb-40fb-b4fb-d8d34845a09d None None] Enqueued Resource ID: d3f8f750-90ff-4f24-a73d-d17032d48abe with Priority: HIGHEST for action port [ 627.199178] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.199346] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.199499] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.199634] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.199860] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.199983] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-17723506-f4df-4fe9-abef-23d187f43713" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.200997] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3f8f750-90ff-4f24-a73d-d17032d48abe with Priority: HIGHEST for action port [ 627.201479] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-d3f8f750-90ff-4f24-a73d-d17032d48abe taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.201583] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d3f8f750-90ff-4f24-a73d-d17032d48abe" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.201649] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d3f8f750-90ff-4f24-a73d-d17032d48abe" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.203781] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d3f8f750-90ff-4f24-a73d-d17032d48abe" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.203781] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d3f8f750-90ff-4f24-a73d-d17032d48abe',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.206026] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.206026] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.206026] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.206026] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.206026] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.206315] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 45780cba-cd94-4a19-b7a8-aa324fdcb9c5 already deleted. [ 627.206315] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-45780cba-cd94-4a19-b7a8-aa324fdcb9c5" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.335635] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.335635] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.335635] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.335635] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.335635] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.335635] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.335635] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.335635] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.335635] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.335635] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.335635] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c042e2fd-851d-4970-9cfd-994d6fa3bc3a already deleted. [ 627.336305] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c042e2fd-851d-4970-9cfd-994d6fa3bc3a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.469879] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock network-686 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.469879] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "network-686" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.470065] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "network-686" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.470386] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "network-686" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.470884] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.472265] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.472735] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.472879] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.473827] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.473827] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 627.473827] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] NeedRegenerationException {{(pid=69232) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 627.473827] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] no value, waiting for create lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 627.473998] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] value creation lock acquired {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 627.473998] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 627.474273] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Calling creation function for not-yet-present value {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 627.474768] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 627.501208] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 627.501699] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=69232) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 627.501950] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Released creation lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 627.502153] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "network-686" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.502741] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock port-058902a9-11d4-4d3a-9373-6e17833576c9 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.503242] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "port-058902a9-11d4-4d3a-9373-6e17833576c9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.503406] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "port-058902a9-11d4-4d3a-9373-6e17833576c9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.503934] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "port-058902a9-11d4-4d3a-9373-6e17833576c9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.503934] env[69232]: DEBUG networking_nsxv3.api.rpc [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('058902a9-11d4-4d3a-9373-6e17833576c9',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.661369] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('59f751d0-35f1-46f2-bae9-2c23df6749c4',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.704557] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d3f8f750-90ff-4f24-a73d-d17032d48abe [ 627.704792] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.704934] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.705007] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.705468] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.705468] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.705468] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d3f8f750-90ff-4f24-a73d-d17032d48abe already deleted. [ 627.705468] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d3f8f750-90ff-4f24-a73d-d17032d48abe" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.007491] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.007813] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.007877] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.008586] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.008586] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.008806] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Segment Port 058902a9-11d4-4d3a-9373-6e17833576c9 not found, creating... [ 628.011021] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.011021] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.011021] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.011021] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.011021] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.011021] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.011021] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.011021] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.011021] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.011021] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.011456] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Resource: SegmentPort with ID: 058902a9-11d4-4d3a-9373-6e17833576c9 is going to be created. [ 628.043692] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.043692] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.043692] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.043692] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.043692] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.043692] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "port-058902a9-11d4-4d3a-9373-6e17833576c9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.133729] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock network-497 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.134049] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "network-497" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.134049] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "network-497" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.134753] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "network-497" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.134753] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.134901] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.135251] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.135705] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.135705] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.136900] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 628.136900] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] NeedRegenerationException {{(pid=69232) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 628.136900] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] no value, waiting for create lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 628.136900] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] value creation lock acquired {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 628.136900] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 628.136900] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Calling creation function for not-yet-present value {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 628.136900] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 628.164244] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 628.164405] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=69232) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 628.164546] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Released creation lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 628.164727] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "network-497" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.165080] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock port-9beeb9dc-f993-46e3-bd2e-433de7596cc2 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.165449] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "port-9beeb9dc-f993-46e3-bd2e-433de7596cc2" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.165449] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "port-9beeb9dc-f993-46e3-bd2e-433de7596cc2" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.166106] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "port-9beeb9dc-f993-46e3-bd2e-433de7596cc2" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.166106] env[69232]: DEBUG networking_nsxv3.api.rpc [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9beeb9dc-f993-46e3-bd2e-433de7596cc2',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.167740] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.167740] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.167740] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.167964] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.167964] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.167964] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 59f751d0-35f1-46f2-bae9-2c23df6749c4 is going to be created. [ 628.211719] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.211719] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.211719] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.211719] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.212013] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.232050] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 59f751d0-35f1-46f2-bae9-2c23df6749c4 in Status: UNINITIALIZED for 2s [ 628.458761] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4046c2da-b145-4a23-9fac-fd79697872c1 in Status: SUCCESS [ 628.459026] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4046c2da-b145-4a23-9fac-fd79697872c1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.461085] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4046c2da-b145-4a23-9fac-fd79697872c1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.461402] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4046c2da-b145-4a23-9fac-fd79697872c1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.461621] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.461750] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.461811] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.462033] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.462119] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.462207] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4046c2da-b145-4a23-9fac-fd79697872c1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.462298] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4046c2da-b145-4a23-9fac-fd79697872c1',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.671462] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.671462] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.671574] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.671847] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.671989] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.672155] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Segment Port 9beeb9dc-f993-46e3-bd2e-433de7596cc2 not found, creating... [ 628.672426] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.672624] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.675874] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.676286] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.676571] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.676997] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.677226] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.677372] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.677651] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.677812] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.677963] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Resource: SegmentPort with ID: 9beeb9dc-f993-46e3-bd2e-433de7596cc2 is going to be created. [ 628.703210] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.703210] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.703210] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.703447] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.703710] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.704055] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "port-9beeb9dc-f993-46e3-bd2e-433de7596cc2" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.971492] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-4046c2da-b145-4a23-9fac-fd79697872c1 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.971651] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4046c2da-b145-4a23-9fac-fd79697872c1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.971720] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4046c2da-b145-4a23-9fac-fd79697872c1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.971936] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4046c2da-b145-4a23-9fac-fd79697872c1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.972113] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.972212] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.972272] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.972419] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.972500] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.972583] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4046c2da-b145-4a23-9fac-fd79697872c1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.972759] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-4046c2da-b145-4a23-9fac-fd79697872c1 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.972851] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4046c2da-b145-4a23-9fac-fd79697872c1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.972958] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4046c2da-b145-4a23-9fac-fd79697872c1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.973124] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4046c2da-b145-4a23-9fac-fd79697872c1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.973192] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.973270] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.973326] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.973459] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.973527] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.973618] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4046c2da-b145-4a23-9fac-fd79697872c1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.973693] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4046c2da-b145-4a23-9fac-fd79697872c1',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.323038] env[69232]: INFO networking_nsxv3.common.synchronization [None req-ccfad295-19a0-47b3-877d-ff0a0dfe9e30 None None] Enqueued Resource ID: f5e6932b-e605-4ebc-b09d-714fa5c0401c with Priority: HIGHEST for action port [ 629.323038] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5e6932b-e605-4ebc-b09d-714fa5c0401c with Priority: HIGHEST for action port [ 629.323038] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-f5e6932b-e605-4ebc-b09d-714fa5c0401c taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.323038] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f5e6932b-e605-4ebc-b09d-714fa5c0401c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.323038] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f5e6932b-e605-4ebc-b09d-714fa5c0401c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.323579] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f5e6932b-e605-4ebc-b09d-714fa5c0401c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.323579] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f5e6932b-e605-4ebc-b09d-714fa5c0401c',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.476532] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4046c2da-b145-4a23-9fac-fd79697872c1: rpc.has_security_group_logging(os_id): False [ 629.496783] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.497098] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.497098] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.498979] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.498979] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.498979] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.498979] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.498979] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.498979] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.498979] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.498979] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.498979] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.498979] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.498979] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.498979] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.498979] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.498979] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.499903] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.499903] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.499903] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.499903] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4046c2da-b145-4a23-9fac-fd79697872c1 is going to be created. [ 629.503470] env[69232]: INFO networking_nsxv3.common.synchronization [None req-1d8038c3-b13a-4f3e-8514-17f2d26c1f08 None None] Enqueued Resource ID: 9bd6504d-be89-40bf-99cd-74db9ed35e2e with Priority: HIGHEST for action port [ 629.504136] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9bd6504d-be89-40bf-99cd-74db9ed35e2e with Priority: HIGHEST for action port [ 629.504579] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-9bd6504d-be89-40bf-99cd-74db9ed35e2e taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.504739] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9bd6504d-be89-40bf-99cd-74db9ed35e2e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.504801] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9bd6504d-be89-40bf-99cd-74db9ed35e2e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.505227] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9bd6504d-be89-40bf-99cd-74db9ed35e2e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.505321] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9bd6504d-be89-40bf-99cd-74db9ed35e2e',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.560285] env[69232]: INFO networking_nsxv3.common.synchronization [None req-b4c6eab2-10c5-4445-8fc0-d703980de11e None None] Enqueued Resource ID: a3decfcc-aa0e-43ea-be1b-b18178125055 with Priority: HIGHEST for action port [ 629.562086] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3decfcc-aa0e-43ea-be1b-b18178125055 with Priority: HIGHEST for action port [ 629.562577] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-a3decfcc-aa0e-43ea-be1b-b18178125055 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.562800] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a3decfcc-aa0e-43ea-be1b-b18178125055" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.563319] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a3decfcc-aa0e-43ea-be1b-b18178125055" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.563693] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a3decfcc-aa0e-43ea-be1b-b18178125055" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.563811] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a3decfcc-aa0e-43ea-be1b-b18178125055',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.578885] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.579089] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.579476] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.579837] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.580264] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.596605] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4046c2da-b145-4a23-9fac-fd79697872c1 in Status: IN_PROGRESS for 2s [ 629.826076] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f5e6932b-e605-4ebc-b09d-714fa5c0401c [ 629.829915] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.830494] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.830494] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.830635] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.830736] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.830839] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f5e6932b-e605-4ebc-b09d-714fa5c0401c already deleted. [ 629.830927] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f5e6932b-e605-4ebc-b09d-714fa5c0401c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.009068] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9bd6504d-be89-40bf-99cd-74db9ed35e2e [ 630.009068] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.009068] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.009068] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.009252] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.009335] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.009429] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9bd6504d-be89-40bf-99cd-74db9ed35e2e already deleted. [ 630.009504] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9bd6504d-be89-40bf-99cd-74db9ed35e2e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.066040] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a3decfcc-aa0e-43ea-be1b-b18178125055 [ 630.066298] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.066458] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.066534] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.066881] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.066986] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.067129] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a3decfcc-aa0e-43ea-be1b-b18178125055 already deleted. [ 630.067218] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a3decfcc-aa0e-43ea-be1b-b18178125055" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.241675] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 59f751d0-35f1-46f2-bae9-2c23df6749c4 in Status: SUCCESS [ 630.241907] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-59f751d0-35f1-46f2-bae9-2c23df6749c4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.242098] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-59f751d0-35f1-46f2-bae9-2c23df6749c4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.242314] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-59f751d0-35f1-46f2-bae9-2c23df6749c4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.242509] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.242629] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.242696] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.242854] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.242934] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.243029] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-59f751d0-35f1-46f2-bae9-2c23df6749c4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.243125] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('59f751d0-35f1-46f2-bae9-2c23df6749c4',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.468521] env[69232]: INFO networking_nsxv3.common.synchronization [req-3360cd82-1ee4-4a68-bc20-ba3db939841d req-17a3569a-bb5a-4fdb-98ac-0cbeac27f696 service nova] Enqueued Resource ID: c042e2fd-851d-4970-9cfd-994d6fa3bc3a with Priority: HIGHEST for action security_group_rules [ 630.468820] env[69232]: INFO networking_nsxv3.common.synchronization [req-3360cd82-1ee4-4a68-bc20-ba3db939841d req-17a3569a-bb5a-4fdb-98ac-0cbeac27f696 service nova] Enqueued Resource ID: c042e2fd-851d-4970-9cfd-994d6fa3bc3a with Priority: HIGHEST for action security_group_members [ 630.468872] env[69232]: INFO networking_nsxv3.common.synchronization [req-3360cd82-1ee4-4a68-bc20-ba3db939841d req-17a3569a-bb5a-4fdb-98ac-0cbeac27f696 service nova] Enqueued Resource ID: 9beeb9dc-f993-46e3-bd2e-433de7596cc2 with Priority: HIGHEST for action port [ 630.469163] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c042e2fd-851d-4970-9cfd-994d6fa3bc3a with Priority: HIGHEST for action security_group_rules [ 630.470997] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c042e2fd-851d-4970-9cfd-994d6fa3bc3a with Priority: HIGHEST for action security_group_members [ 630.474701] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9beeb9dc-f993-46e3-bd2e-433de7596cc2 with Priority: HIGHEST for action port [ 630.474701] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c042e2fd-851d-4970-9cfd-994d6fa3bc3a taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.474701] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c042e2fd-851d-4970-9cfd-994d6fa3bc3a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.474701] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c042e2fd-851d-4970-9cfd-994d6fa3bc3a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.474701] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c042e2fd-851d-4970-9cfd-994d6fa3bc3a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.474701] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c042e2fd-851d-4970-9cfd-994d6fa3bc3a',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.474701] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-c042e2fd-851d-4970-9cfd-994d6fa3bc3a taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.474965] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c042e2fd-851d-4970-9cfd-994d6fa3bc3a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.474965] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c042e2fd-851d-4970-9cfd-994d6fa3bc3a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.475036] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c042e2fd-851d-4970-9cfd-994d6fa3bc3a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.475404] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.475404] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.476235] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.476413] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.476616] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.476616] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c042e2fd-851d-4970-9cfd-994d6fa3bc3a',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.481022] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-9beeb9dc-f993-46e3-bd2e-433de7596cc2 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.481022] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9beeb9dc-f993-46e3-bd2e-433de7596cc2" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.481022] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9beeb9dc-f993-46e3-bd2e-433de7596cc2" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.481022] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9beeb9dc-f993-46e3-bd2e-433de7596cc2" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.481022] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9beeb9dc-f993-46e3-bd2e-433de7596cc2',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.621654] env[69232]: INFO networking_nsxv3.common.synchronization [req-2056b5a5-18d5-4755-872f-f932f75cc8da req-b8e23f60-1eb0-4511-bd83-95bbac0e7a36 service nova] Enqueued Resource ID: 21513cb2-4b6e-4c9f-864c-d3d144ce0d57 with Priority: HIGHEST for action security_group_rules [ 630.621829] env[69232]: INFO networking_nsxv3.common.synchronization [req-2056b5a5-18d5-4755-872f-f932f75cc8da req-b8e23f60-1eb0-4511-bd83-95bbac0e7a36 service nova] Enqueued Resource ID: 21513cb2-4b6e-4c9f-864c-d3d144ce0d57 with Priority: HIGHEST for action security_group_members [ 630.621964] env[69232]: INFO networking_nsxv3.common.synchronization [req-2056b5a5-18d5-4755-872f-f932f75cc8da req-b8e23f60-1eb0-4511-bd83-95bbac0e7a36 service nova] Enqueued Resource ID: 058902a9-11d4-4d3a-9373-6e17833576c9 with Priority: HIGHEST for action port [ 630.622211] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21513cb2-4b6e-4c9f-864c-d3d144ce0d57 with Priority: HIGHEST for action security_group_rules [ 630.622340] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21513cb2-4b6e-4c9f-864c-d3d144ce0d57 with Priority: HIGHEST for action security_group_members [ 630.622435] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 058902a9-11d4-4d3a-9373-6e17833576c9 with Priority: HIGHEST for action port [ 630.622992] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-21513cb2-4b6e-4c9f-864c-d3d144ce0d57 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.623200] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-21513cb2-4b6e-4c9f-864c-d3d144ce0d57" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.623270] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-21513cb2-4b6e-4c9f-864c-d3d144ce0d57" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.623474] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-21513cb2-4b6e-4c9f-864c-d3d144ce0d57" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.623554] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('21513cb2-4b6e-4c9f-864c-d3d144ce0d57',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.624881] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-21513cb2-4b6e-4c9f-864c-d3d144ce0d57 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.625232] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21513cb2-4b6e-4c9f-864c-d3d144ce0d57" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.625232] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21513cb2-4b6e-4c9f-864c-d3d144ce0d57" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.625345] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21513cb2-4b6e-4c9f-864c-d3d144ce0d57" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.625539] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.625641] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.625705] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.625877] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.625972] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.626085] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('21513cb2-4b6e-4c9f-864c-d3d144ce0d57',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.626878] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-058902a9-11d4-4d3a-9373-6e17833576c9 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.626983] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-058902a9-11d4-4d3a-9373-6e17833576c9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.627062] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-058902a9-11d4-4d3a-9373-6e17833576c9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.627218] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-058902a9-11d4-4d3a-9373-6e17833576c9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.627288] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('058902a9-11d4-4d3a-9373-6e17833576c9',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.752091] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-59f751d0-35f1-46f2-bae9-2c23df6749c4 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.752263] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-59f751d0-35f1-46f2-bae9-2c23df6749c4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.752377] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-59f751d0-35f1-46f2-bae9-2c23df6749c4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.752534] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-59f751d0-35f1-46f2-bae9-2c23df6749c4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.752759] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.752881] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.752945] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.753139] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.753223] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.753309] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-59f751d0-35f1-46f2-bae9-2c23df6749c4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.753474] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-59f751d0-35f1-46f2-bae9-2c23df6749c4 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.753560] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-59f751d0-35f1-46f2-bae9-2c23df6749c4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.753612] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-59f751d0-35f1-46f2-bae9-2c23df6749c4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.753777] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-59f751d0-35f1-46f2-bae9-2c23df6749c4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.753924] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.754341] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.754341] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.754341] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.754496] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.754496] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-59f751d0-35f1-46f2-bae9-2c23df6749c4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.754565] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('59f751d0-35f1-46f2-bae9-2c23df6749c4',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.980430] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c042e2fd-851d-4970-9cfd-994d6fa3bc3a',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.982984] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-c042e2fd-851d-4970-9cfd-994d6fa3bc3a taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.982984] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c042e2fd-851d-4970-9cfd-994d6fa3bc3a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.987737] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9beeb9dc-f993-46e3-bd2e-433de7596cc2 with status ACTIVE [ 630.987957] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.988122] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.988191] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.988413] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.988592] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.989313] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.989467] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.989517] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.989879] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.989969] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.990186] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.990290] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.990347] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.990509] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.990590] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.990715] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9beeb9dc-f993-46e3-bd2e-433de7596cc2 is going to be updated. [ 631.017786] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.017786] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.017786] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.017786] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.018390] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.018390] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9beeb9dc-f993-46e3-bd2e-433de7596cc2" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.128836] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-21513cb2-4b6e-4c9f-864c-d3d144ce0d57 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.128975] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21513cb2-4b6e-4c9f-864c-d3d144ce0d57" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.129178] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('21513cb2-4b6e-4c9f-864c-d3d144ce0d57',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.131394] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 058902a9-11d4-4d3a-9373-6e17833576c9 with status ACTIVE [ 631.138023] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.138023] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.138023] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.138023] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.138023] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.138023] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.138023] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.138023] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.138023] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.138023] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.138023] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.138023] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.138023] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.138023] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.138023] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.138023] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 058902a9-11d4-4d3a-9373-6e17833576c9 is going to be updated. [ 631.167617] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.168902] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.170239] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.170239] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.170239] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.170239] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-058902a9-11d4-4d3a-9373-6e17833576c9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.261421] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 59f751d0-35f1-46f2-bae9-2c23df6749c4: rpc.has_security_group_logging(os_id): False [ 631.301404] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.301593] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.301593] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.301907] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.302015] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.302336] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.302468] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.302547] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.302809] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.303079] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.303128] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.303267] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.303349] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.303544] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.303650] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.303887] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.304116] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.304116] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.304222] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.304281] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.304437] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 59f751d0-35f1-46f2-bae9-2c23df6749c4 is going to be created. [ 631.405459] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.405459] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.405459] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.405459] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.405459] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.419613] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 59f751d0-35f1-46f2-bae9-2c23df6749c4 in Status: IN_PROGRESS for 2s [ 631.484629] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c042e2fd-851d-4970-9cfd-994d6fa3bc3a',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.512795] env[69232]: INFO networking_nsxv3.common.synchronization [None req-b97d2f05-c1a7-4281-b0f3-f6edd4cf0f19 None None] Enqueued Resource ID: 2c2d04b1-f96b-465e-8459-ed3ebf6d75f9 with Priority: HIGHEST for action port [ 631.518030] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c2d04b1-f96b-465e-8459-ed3ebf6d75f9 with Priority: HIGHEST for action port [ 631.518030] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-2c2d04b1-f96b-465e-8459-ed3ebf6d75f9 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.518030] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2c2d04b1-f96b-465e-8459-ed3ebf6d75f9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.518030] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2c2d04b1-f96b-465e-8459-ed3ebf6d75f9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.518030] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2c2d04b1-f96b-465e-8459-ed3ebf6d75f9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.518030] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2c2d04b1-f96b-465e-8459-ed3ebf6d75f9',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.534259] env[69232]: INFO networking_nsxv3.common.synchronization [req-faa1899b-96e5-4dc8-bf00-faa15f30f052 req-389b0070-db99-477b-a5b8-648424ce52e9 tempest-ServersWithSpecificFlavorTestJSON-338716906 tempest-ServersWithSpecificFlavorTestJSON-338716906-project-member] Enqueued Resource ID: 06438b8f-6cee-4263-9d4c-43067bbe0a4c with Priority: HIGHEST for action security_group_members [ 631.536364] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06438b8f-6cee-4263-9d4c-43067bbe0a4c with Priority: HIGHEST for action security_group_members [ 631.536364] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-06438b8f-6cee-4263-9d4c-43067bbe0a4c taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.536563] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06438b8f-6cee-4263-9d4c-43067bbe0a4c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.537152] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06438b8f-6cee-4263-9d4c-43067bbe0a4c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.537152] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06438b8f-6cee-4263-9d4c-43067bbe0a4c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.537326] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.537384] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.537456] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.537700] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.537828] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.537952] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06438b8f-6cee-4263-9d4c-43067bbe0a4c',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.615622] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4046c2da-b145-4a23-9fac-fd79697872c1 in Status: SUCCESS [ 631.615840] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4046c2da-b145-4a23-9fac-fd79697872c1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.632262] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('21513cb2-4b6e-4c9f-864c-d3d144ce0d57',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.966989] env[69232]: INFO networking_nsxv3.common.synchronization [None req-3e09451b-9fd6-427a-bd40-47b1ccb14e72 None None] Enqueued Resource ID: db11fc78-c1f5-427e-a500-3254ef733960 with Priority: HIGHEST for action port [ 631.966989] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db11fc78-c1f5-427e-a500-3254ef733960 with Priority: HIGHEST for action port [ 631.966989] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-db11fc78-c1f5-427e-a500-3254ef733960 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.966989] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-db11fc78-c1f5-427e-a500-3254ef733960" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.966989] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-db11fc78-c1f5-427e-a500-3254ef733960" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.967290] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-db11fc78-c1f5-427e-a500-3254ef733960" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.967366] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('db11fc78-c1f5-427e-a500-3254ef733960',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.988059] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.988238] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.989231] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.989858] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.990808] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.991009] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c042e2fd-851d-4970-9cfd-994d6fa3bc3a is going to be created. [ 632.021589] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.022732] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.022925] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.023240] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.023549] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.025473] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2c2d04b1-f96b-465e-8459-ed3ebf6d75f9 [ 632.025473] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.025473] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.025473] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.026639] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.026639] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.026786] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2c2d04b1-f96b-465e-8459-ed3ebf6d75f9 already deleted. [ 632.027023] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2c2d04b1-f96b-465e-8459-ed3ebf6d75f9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.039134] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c042e2fd-851d-4970-9cfd-994d6fa3bc3a in Status: UNINITIALIZED for 2s [ 632.042354] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.042354] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.042354] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.042354] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.042354] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.042703] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.042703] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.042703] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.042810] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.042910] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.043057] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06438b8f-6cee-4263-9d4c-43067bbe0a4c already deleted. [ 632.043132] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06438b8f-6cee-4263-9d4c-43067bbe0a4c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.140022] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.140022] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.140022] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.140022] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.140022] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.140022] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 21513cb2-4b6e-4c9f-864c-d3d144ce0d57 is going to be created. [ 632.177470] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.177470] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.177470] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.177470] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.177470] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.197510] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 21513cb2-4b6e-4c9f-864c-d3d144ce0d57 in Status: UNINITIALIZED for 2s [ 632.471476] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port db11fc78-c1f5-427e-a500-3254ef733960 [ 632.472324] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.472455] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.472948] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.472948] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.473114] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.473220] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:db11fc78-c1f5-427e-a500-3254ef733960 already deleted. [ 632.473359] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-db11fc78-c1f5-427e-a500-3254ef733960" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.156164] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock network-295 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.156545] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "network-295" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.156545] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "network-295" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.156821] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "network-295" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.159307] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.159629] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.159629] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.159864] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.160057] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.160299] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 633.160420] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] NeedRegenerationException {{(pid=69232) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 633.160700] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] no value, waiting for create lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 633.160700] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] value creation lock acquired {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 633.160787] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 633.160862] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Calling creation function for not-yet-present value {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 633.161063] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 633.187959] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 633.188165] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=69232) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 633.188455] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Released creation lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 633.188455] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "network-295" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.188801] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock port-5b3d7a16-5d66-48ce-b8a1-fc908230825d taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.188999] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "port-5b3d7a16-5d66-48ce-b8a1-fc908230825d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.189135] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "port-5b3d7a16-5d66-48ce-b8a1-fc908230825d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.189472] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "port-5b3d7a16-5d66-48ce-b8a1-fc908230825d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.189611] env[69232]: DEBUG networking_nsxv3.api.rpc [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5b3d7a16-5d66-48ce-b8a1-fc908230825d',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.441090] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 59f751d0-35f1-46f2-bae9-2c23df6749c4 in Status: SUCCESS [ 633.441446] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-59f751d0-35f1-46f2-bae9-2c23df6749c4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.479033] env[69232]: INFO networking_nsxv3.common.synchronization [None req-165477c9-b4bc-48d0-9da2-a910414f4d5e None None] Enqueued Resource ID: ad955dc7-8e00-41f7-be1d-e2e518e890c1 with Priority: HIGHEST for action port [ 633.479553] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad955dc7-8e00-41f7-be1d-e2e518e890c1 with Priority: HIGHEST for action port [ 633.479923] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-ad955dc7-8e00-41f7-be1d-e2e518e890c1 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.480216] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ad955dc7-8e00-41f7-be1d-e2e518e890c1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.480299] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ad955dc7-8e00-41f7-be1d-e2e518e890c1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.480592] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ad955dc7-8e00-41f7-be1d-e2e518e890c1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.480677] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ad955dc7-8e00-41f7-be1d-e2e518e890c1',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.695696] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.695917] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.696055] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.696379] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.700025] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.700025] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Segment Port 5b3d7a16-5d66-48ce-b8a1-fc908230825d not found, creating... [ 633.700025] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.700025] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.700025] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.700025] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.700025] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.700025] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.700025] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.700025] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.700949] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.700949] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.700949] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Resource: SegmentPort with ID: 5b3d7a16-5d66-48ce-b8a1-fc908230825d is going to be created. [ 633.727615] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.727905] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.728039] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.728334] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.728567] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.728880] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "port-5b3d7a16-5d66-48ce-b8a1-fc908230825d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.873417] env[69232]: INFO networking_nsxv3.common.synchronization [None req-ec992775-b8ab-41ec-9834-b7d462b9b200 None None] Enqueued Resource ID: 06488821-c0f0-4ad9-b83e-dcd26b59bcca with Priority: HIGHEST for action port [ 633.874987] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06488821-c0f0-4ad9-b83e-dcd26b59bcca with Priority: HIGHEST for action port [ 633.875427] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-06488821-c0f0-4ad9-b83e-dcd26b59bcca taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.875573] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-06488821-c0f0-4ad9-b83e-dcd26b59bcca" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.875643] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-06488821-c0f0-4ad9-b83e-dcd26b59bcca" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.875945] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-06488821-c0f0-4ad9-b83e-dcd26b59bcca" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.876247] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('06488821-c0f0-4ad9-b83e-dcd26b59bcca',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.985644] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ad955dc7-8e00-41f7-be1d-e2e518e890c1 [ 633.985761] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.986069] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.986069] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.986200] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.986263] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.986364] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ad955dc7-8e00-41f7-be1d-e2e518e890c1 already deleted. [ 633.986454] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ad955dc7-8e00-41f7-be1d-e2e518e890c1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.032047] env[69232]: INFO networking_nsxv3.common.synchronization [req-d34648ae-9b5b-4b50-aeac-3093c900eeb1 req-0d1c8528-a526-4cf7-8f89-bb8ac1d47d19 tempest-SecurityGroupRulesTestJSON-29443989 tempest-SecurityGroupRulesTestJSON-29443989-project-member] Enqueued Resource ID: 55017cb0-66d6-48f9-8957-e9762d1847fd with Priority: HIGHEST for action security_group_rules [ 634.032665] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55017cb0-66d6-48f9-8957-e9762d1847fd with Priority: HIGHEST for action security_group_rules [ 634.033356] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-55017cb0-66d6-48f9-8957-e9762d1847fd taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.033356] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-55017cb0-66d6-48f9-8957-e9762d1847fd" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.033356] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-55017cb0-66d6-48f9-8957-e9762d1847fd" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.033653] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-55017cb0-66d6-48f9-8957-e9762d1847fd" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.033653] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('55017cb0-66d6-48f9-8957-e9762d1847fd',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.050032] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c042e2fd-851d-4970-9cfd-994d6fa3bc3a in Status: SUCCESS [ 634.050313] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c042e2fd-851d-4970-9cfd-994d6fa3bc3a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.050959] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c042e2fd-851d-4970-9cfd-994d6fa3bc3a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.051279] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c042e2fd-851d-4970-9cfd-994d6fa3bc3a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.051479] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.051600] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.051656] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.051944] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.052205] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.052317] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c042e2fd-851d-4970-9cfd-994d6fa3bc3a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.052477] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c042e2fd-851d-4970-9cfd-994d6fa3bc3a',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.207796] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 21513cb2-4b6e-4c9f-864c-d3d144ce0d57 in Status: SUCCESS [ 634.208170] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21513cb2-4b6e-4c9f-864c-d3d144ce0d57" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.208253] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21513cb2-4b6e-4c9f-864c-d3d144ce0d57" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.208483] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21513cb2-4b6e-4c9f-864c-d3d144ce0d57" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.209110] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.209110] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.209110] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.209405] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.209405] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.209405] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21513cb2-4b6e-4c9f-864c-d3d144ce0d57" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.209505] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('21513cb2-4b6e-4c9f-864c-d3d144ce0d57',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.380449] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 06488821-c0f0-4ad9-b83e-dcd26b59bcca [ 634.380698] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.380835] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.380910] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.381151] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.382945] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.388023] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:06488821-c0f0-4ad9-b83e-dcd26b59bcca already deleted. [ 634.388023] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-06488821-c0f0-4ad9-b83e-dcd26b59bcca" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.554601] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c042e2fd-851d-4970-9cfd-994d6fa3bc3a',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.560473] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.560473] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.560473] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.560473] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.560473] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.560473] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 55017cb0-66d6-48f9-8957-e9762d1847fd already deleted. [ 634.560473] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-55017cb0-66d6-48f9-8957-e9762d1847fd" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.691854] env[69232]: INFO networking_nsxv3.common.synchronization [None req-7767bd80-790f-48cc-9208-041875b9626b None None] Enqueued Resource ID: e698ae25-b88a-4574-b29b-701b8aa36dca with Priority: HIGHEST for action port [ 634.692182] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e698ae25-b88a-4574-b29b-701b8aa36dca with Priority: HIGHEST for action port [ 634.693068] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-e698ae25-b88a-4574-b29b-701b8aa36dca taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.693196] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e698ae25-b88a-4574-b29b-701b8aa36dca" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.693263] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e698ae25-b88a-4574-b29b-701b8aa36dca" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.693858] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e698ae25-b88a-4574-b29b-701b8aa36dca" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.693950] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e698ae25-b88a-4574-b29b-701b8aa36dca',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.711798] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('21513cb2-4b6e-4c9f-864c-d3d144ce0d57',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.942295] env[69232]: INFO networking_nsxv3.common.synchronization [None req-0b531f83-890a-4c05-9f57-338796ae6d5a None None] Enqueued Resource ID: b5431521-9a63-4942-abad-632a5fb65236 with Priority: HIGHEST for action port [ 634.942573] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5431521-9a63-4942-abad-632a5fb65236 with Priority: HIGHEST for action port [ 634.943171] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-b5431521-9a63-4942-abad-632a5fb65236 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.943303] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b5431521-9a63-4942-abad-632a5fb65236" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.943371] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b5431521-9a63-4942-abad-632a5fb65236" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.943624] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b5431521-9a63-4942-abad-632a5fb65236" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.943709] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b5431521-9a63-4942-abad-632a5fb65236',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.062283] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c042e2fd-851d-4970-9cfd-994d6fa3bc3a: rpc.has_security_group_logging(os_id): False [ 635.087604] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.091240] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.091423] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.094118] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.094118] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.094118] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.094118] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.094118] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.094118] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.094118] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.094118] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c042e2fd-851d-4970-9cfd-994d6fa3bc3a is going to be created. [ 635.177905] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.177905] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.177905] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.177905] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.177905] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.199847] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c042e2fd-851d-4970-9cfd-994d6fa3bc3a in Status: IN_PROGRESS for 2s [ 635.199847] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e698ae25-b88a-4574-b29b-701b8aa36dca [ 635.203935] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.209627] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.209627] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.209627] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.209627] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.209627] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e698ae25-b88a-4574-b29b-701b8aa36dca already deleted. [ 635.209627] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e698ae25-b88a-4574-b29b-701b8aa36dca" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.214469] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 21513cb2-4b6e-4c9f-864c-d3d144ce0d57: rpc.has_security_group_logging(os_id): False [ 635.239245] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.239397] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.239551] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.240164] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.240164] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.240164] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.240164] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.240379] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.240379] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.240461] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.240590] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 21513cb2-4b6e-4c9f-864c-d3d144ce0d57 is going to be created. [ 635.325973] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.326241] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.326308] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.326628] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.326683] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.342579] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 21513cb2-4b6e-4c9f-864c-d3d144ce0d57 in Status: IN_PROGRESS for 2s [ 635.456252] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b5431521-9a63-4942-abad-632a5fb65236 [ 635.457231] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.457231] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.457231] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.457231] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.457454] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.457454] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b5431521-9a63-4942-abad-632a5fb65236 already deleted. [ 635.457540] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b5431521-9a63-4942-abad-632a5fb65236" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.627388] env[69232]: INFO networking_nsxv3.common.synchronization [req-faa1899b-96e5-4dc8-bf00-faa15f30f052 req-38f001ff-d4a6-49e1-af3e-db5467bebe28 service nova] Enqueued Resource ID: 06438b8f-6cee-4263-9d4c-43067bbe0a4c with Priority: HIGHEST for action security_group_rules [ 635.627388] env[69232]: INFO networking_nsxv3.common.synchronization [req-faa1899b-96e5-4dc8-bf00-faa15f30f052 req-38f001ff-d4a6-49e1-af3e-db5467bebe28 service nova] Enqueued Resource ID: 06438b8f-6cee-4263-9d4c-43067bbe0a4c with Priority: HIGHEST for action security_group_members [ 635.627388] env[69232]: INFO networking_nsxv3.common.synchronization [req-faa1899b-96e5-4dc8-bf00-faa15f30f052 req-38f001ff-d4a6-49e1-af3e-db5467bebe28 service nova] Enqueued Resource ID: 5b3d7a16-5d66-48ce-b8a1-fc908230825d with Priority: HIGHEST for action port [ 635.627388] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06438b8f-6cee-4263-9d4c-43067bbe0a4c with Priority: HIGHEST for action security_group_rules [ 635.627388] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06438b8f-6cee-4263-9d4c-43067bbe0a4c with Priority: HIGHEST for action security_group_members [ 635.627388] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b3d7a16-5d66-48ce-b8a1-fc908230825d with Priority: HIGHEST for action port [ 635.628436] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-06438b8f-6cee-4263-9d4c-43067bbe0a4c taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.628559] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-06438b8f-6cee-4263-9d4c-43067bbe0a4c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.628672] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-06438b8f-6cee-4263-9d4c-43067bbe0a4c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.628964] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-06438b8f-6cee-4263-9d4c-43067bbe0a4c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.629095] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('06438b8f-6cee-4263-9d4c-43067bbe0a4c',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.630022] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-06438b8f-6cee-4263-9d4c-43067bbe0a4c taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.630274] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06438b8f-6cee-4263-9d4c-43067bbe0a4c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.630274] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06438b8f-6cee-4263-9d4c-43067bbe0a4c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.630839] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06438b8f-6cee-4263-9d4c-43067bbe0a4c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.630839] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.630839] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.630839] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.630839] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.631132] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.631132] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06438b8f-6cee-4263-9d4c-43067bbe0a4c',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.631837] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-5b3d7a16-5d66-48ce-b8a1-fc908230825d taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.631837] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5b3d7a16-5d66-48ce-b8a1-fc908230825d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.631966] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5b3d7a16-5d66-48ce-b8a1-fc908230825d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.633372] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5b3d7a16-5d66-48ce-b8a1-fc908230825d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.633372] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5b3d7a16-5d66-48ce-b8a1-fc908230825d',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.986978] env[69232]: INFO networking_nsxv3.common.synchronization [None req-987665a5-01a8-4e55-b52b-0912a3a97eaf None None] Enqueued Resource ID: dd8ce4d5-f21b-4c9e-8657-576ebcd3176f with Priority: HIGHEST for action port [ 635.986978] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd8ce4d5-f21b-4c9e-8657-576ebcd3176f with Priority: HIGHEST for action port [ 635.986978] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-dd8ce4d5-f21b-4c9e-8657-576ebcd3176f taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.986978] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dd8ce4d5-f21b-4c9e-8657-576ebcd3176f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.989185] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dd8ce4d5-f21b-4c9e-8657-576ebcd3176f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.990366] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dd8ce4d5-f21b-4c9e-8657-576ebcd3176f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.990366] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dd8ce4d5-f21b-4c9e-8657-576ebcd3176f',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.084725] env[69232]: INFO networking_nsxv3.common.synchronization [None req-658c1bc8-24db-4744-9554-b70b660261b7 None None] Enqueued Resource ID: b21a321b-3eb6-47cd-ae62-c6347908140a with Priority: HIGHEST for action port [ 636.086329] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b21a321b-3eb6-47cd-ae62-c6347908140a with Priority: HIGHEST for action port [ 636.086909] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-b21a321b-3eb6-47cd-ae62-c6347908140a taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.087070] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b21a321b-3eb6-47cd-ae62-c6347908140a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.087070] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b21a321b-3eb6-47cd-ae62-c6347908140a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.087467] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b21a321b-3eb6-47cd-ae62-c6347908140a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.087558] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b21a321b-3eb6-47cd-ae62-c6347908140a',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.136624] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-06438b8f-6cee-4263-9d4c-43067bbe0a4c taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.136624] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06438b8f-6cee-4263-9d4c-43067bbe0a4c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.136624] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('06438b8f-6cee-4263-9d4c-43067bbe0a4c',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.138320] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5b3d7a16-5d66-48ce-b8a1-fc908230825d with status ACTIVE [ 636.138814] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.139102] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.139262] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.139574] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.139771] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.140326] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.141691] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.141691] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.141691] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.141691] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.141691] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.141691] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.141691] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.141691] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.141691] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.141691] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5b3d7a16-5d66-48ce-b8a1-fc908230825d is going to be updated. [ 636.187066] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.187983] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.187983] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.187983] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.187983] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.187983] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5b3d7a16-5d66-48ce-b8a1-fc908230825d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.492343] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port dd8ce4d5-f21b-4c9e-8657-576ebcd3176f [ 636.492343] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.492343] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.492905] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.494059] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.494059] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.494059] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:dd8ce4d5-f21b-4c9e-8657-576ebcd3176f already deleted. [ 636.494059] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dd8ce4d5-f21b-4c9e-8657-576ebcd3176f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.590387] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b21a321b-3eb6-47cd-ae62-c6347908140a [ 636.590688] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.590859] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.590953] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.591255] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.591391] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.591520] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b21a321b-3eb6-47cd-ae62-c6347908140a already deleted. [ 636.591630] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b21a321b-3eb6-47cd-ae62-c6347908140a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.639217] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('06438b8f-6cee-4263-9d4c-43067bbe0a4c',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.142611] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.142886] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.142947] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.143194] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.143284] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.143414] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06438b8f-6cee-4263-9d4c-43067bbe0a4c is going to be created. [ 637.179037] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.179260] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.179260] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.180657] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.180657] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.197931] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06438b8f-6cee-4263-9d4c-43067bbe0a4c in Status: UNINITIALIZED for 2s [ 637.223981] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c042e2fd-851d-4970-9cfd-994d6fa3bc3a in Status: SUCCESS [ 637.223981] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c042e2fd-851d-4970-9cfd-994d6fa3bc3a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.357135] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 21513cb2-4b6e-4c9f-864c-d3d144ce0d57 in Status: SUCCESS [ 637.357539] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-21513cb2-4b6e-4c9f-864c-d3d144ce0d57" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.473125] env[69232]: INFO networking_nsxv3.common.synchronization [req-4051c26f-db3f-4026-aa9f-2a7e58edc6fc req-2bfb9b3e-b83b-471b-9cb4-9580d1d1a09f tempest-ListImageFiltersTestJSON-1520270285 tempest-ListImageFiltersTestJSON-1520270285-project-member] Enqueued Resource ID: dcd9f79f-c997-4a2d-83a2-472c849b1794 with Priority: HIGHEST for action security_group_members [ 637.473125] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dcd9f79f-c997-4a2d-83a2-472c849b1794 with Priority: HIGHEST for action security_group_members [ 637.473125] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-dcd9f79f-c997-4a2d-83a2-472c849b1794 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.473125] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dcd9f79f-c997-4a2d-83a2-472c849b1794" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.473125] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dcd9f79f-c997-4a2d-83a2-472c849b1794" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.479480] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dcd9f79f-c997-4a2d-83a2-472c849b1794" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.479480] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.479480] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.479480] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.479480] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.479480] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.479480] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dcd9f79f-c997-4a2d-83a2-472c849b1794',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.881096] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock network-225 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.881377] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "network-225" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.881415] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "network-225" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.881686] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "network-225" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.881940] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.883252] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.883409] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.883652] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.883799] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.884083] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 637.884209] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] NeedRegenerationException {{(pid=69232) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 637.884326] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] no value, waiting for create lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 637.884437] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] value creation lock acquired {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 637.884554] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 637.884663] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Calling creation function for not-yet-present value {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 637.884909] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 637.907082] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 637.907783] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69232) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 637.908311] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Released creation lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 637.908311] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "network-225" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.908581] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock port-3b566d26-410e-4299-a228-21c6329812d0 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.908970] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "port-3b566d26-410e-4299-a228-21c6329812d0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.909212] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "port-3b566d26-410e-4299-a228-21c6329812d0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.909568] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "port-3b566d26-410e-4299-a228-21c6329812d0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.909718] env[69232]: DEBUG networking_nsxv3.api.rpc [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3b566d26-410e-4299-a228-21c6329812d0',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.984861] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.985577] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.985934] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.986078] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.986267] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.986861] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.986861] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.986861] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.986861] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.987093] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.987209] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dcd9f79f-c997-4a2d-83a2-472c849b1794 already deleted. [ 637.987314] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dcd9f79f-c997-4a2d-83a2-472c849b1794" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.412473] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.412588] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.412672] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.414116] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.414116] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.414116] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Segment Port 3b566d26-410e-4299-a228-21c6329812d0 not found, creating... [ 638.414116] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.414116] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.414116] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.415207] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.415207] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.415603] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.415806] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.415921] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.416174] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.416309] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.416519] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Resource: SegmentPort with ID: 3b566d26-410e-4299-a228-21c6329812d0 is going to be created. [ 638.443370] env[69232]: INFO networking_nsxv3.common.synchronization [None req-b26c822e-d6a8-463f-a12f-cc9dd06e5a9d None None] Enqueued Resource ID: 7b95f07a-9a59-41d4-b493-18f73e120197 with Priority: HIGHEST for action port [ 638.443955] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b95f07a-9a59-41d4-b493-18f73e120197 with Priority: HIGHEST for action port [ 638.444334] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-7b95f07a-9a59-41d4-b493-18f73e120197 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.448056] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7b95f07a-9a59-41d4-b493-18f73e120197" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.448317] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7b95f07a-9a59-41d4-b493-18f73e120197" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.448660] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7b95f07a-9a59-41d4-b493-18f73e120197" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.448854] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7b95f07a-9a59-41d4-b493-18f73e120197',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.450964] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.451153] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.451334] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.451640] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.451881] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.452167] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "port-3b566d26-410e-4299-a228-21c6329812d0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.956192] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7b95f07a-9a59-41d4-b493-18f73e120197 [ 638.956192] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.956192] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.956192] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.956192] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.956192] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.956192] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7b95f07a-9a59-41d4-b493-18f73e120197 already deleted. [ 638.956192] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7b95f07a-9a59-41d4-b493-18f73e120197" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.961167] env[69232]: INFO networking_nsxv3.common.synchronization [None req-5fee4ac0-3ae3-445e-b046-5f7643db0022 None None] Enqueued Resource ID: 74dcb095-ae43-4814-8cb4-8e2f04f5ae68 with Priority: HIGHEST for action port [ 638.961888] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 74dcb095-ae43-4814-8cb4-8e2f04f5ae68 with Priority: HIGHEST for action port [ 638.962264] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-74dcb095-ae43-4814-8cb4-8e2f04f5ae68 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.962900] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-74dcb095-ae43-4814-8cb4-8e2f04f5ae68" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.962900] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-74dcb095-ae43-4814-8cb4-8e2f04f5ae68" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.962900] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-74dcb095-ae43-4814-8cb4-8e2f04f5ae68" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.962900] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('74dcb095-ae43-4814-8cb4-8e2f04f5ae68',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.208980] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06438b8f-6cee-4263-9d4c-43067bbe0a4c in Status: SUCCESS [ 639.209630] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06438b8f-6cee-4263-9d4c-43067bbe0a4c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.209630] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06438b8f-6cee-4263-9d4c-43067bbe0a4c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.209829] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06438b8f-6cee-4263-9d4c-43067bbe0a4c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.209976] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.210106] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.210162] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.210336] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.210438] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.210535] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06438b8f-6cee-4263-9d4c-43067bbe0a4c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.210641] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('06438b8f-6cee-4263-9d4c-43067bbe0a4c',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.465394] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 74dcb095-ae43-4814-8cb4-8e2f04f5ae68 [ 639.465627] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.467031] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.467031] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.467031] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.467031] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.467031] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:74dcb095-ae43-4814-8cb4-8e2f04f5ae68 already deleted. [ 639.467031] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-74dcb095-ae43-4814-8cb4-8e2f04f5ae68" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.572663] env[69232]: INFO networking_nsxv3.common.synchronization [None req-9f01b1a3-e3ee-4d2e-866e-4ed8461f9dc2 None None] Enqueued Resource ID: e268e8f2-4a55-4082-8a7e-cc360c3f6f0a with Priority: HIGHEST for action port [ 639.572663] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e268e8f2-4a55-4082-8a7e-cc360c3f6f0a with Priority: HIGHEST for action port [ 639.573135] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-e268e8f2-4a55-4082-8a7e-cc360c3f6f0a taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.573269] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e268e8f2-4a55-4082-8a7e-cc360c3f6f0a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.573338] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e268e8f2-4a55-4082-8a7e-cc360c3f6f0a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.574033] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e268e8f2-4a55-4082-8a7e-cc360c3f6f0a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.574033] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e268e8f2-4a55-4082-8a7e-cc360c3f6f0a',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.713851] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('06438b8f-6cee-4263-9d4c-43067bbe0a4c',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.744357] env[69232]: INFO networking_nsxv3.common.synchronization [req-51b36e18-7162-4afa-97ec-cddef1d6c507 req-c6ba7520-5eba-4575-924b-be730134c971 tempest-ListImageFiltersTestJSON-1520270285 tempest-ListImageFiltersTestJSON-1520270285-project-member] Enqueued Resource ID: dcd9f79f-c997-4a2d-83a2-472c849b1794 with Priority: HIGHEST for action security_group_members [ 639.744420] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dcd9f79f-c997-4a2d-83a2-472c849b1794 with Priority: HIGHEST for action security_group_members [ 639.744685] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-dcd9f79f-c997-4a2d-83a2-472c849b1794 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.746039] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dcd9f79f-c997-4a2d-83a2-472c849b1794" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.746039] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dcd9f79f-c997-4a2d-83a2-472c849b1794" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.746330] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dcd9f79f-c997-4a2d-83a2-472c849b1794" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.746520] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.746855] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.747096] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.747372] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.747501] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.747719] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dcd9f79f-c997-4a2d-83a2-472c849b1794',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.887635] env[69232]: INFO networking_nsxv3.common.synchronization [req-4051c26f-db3f-4026-aa9f-2a7e58edc6fc req-870fa6fb-2fde-44c8-aa58-61656744b5d5 service nova] Enqueued Resource ID: dcd9f79f-c997-4a2d-83a2-472c849b1794 with Priority: HIGHEST for action security_group_rules [ 639.887635] env[69232]: INFO networking_nsxv3.common.synchronization [req-4051c26f-db3f-4026-aa9f-2a7e58edc6fc req-870fa6fb-2fde-44c8-aa58-61656744b5d5 service nova] Enqueued Resource ID: dcd9f79f-c997-4a2d-83a2-472c849b1794 with Priority: HIGHEST for action security_group_members [ 639.887635] env[69232]: INFO networking_nsxv3.common.synchronization [req-4051c26f-db3f-4026-aa9f-2a7e58edc6fc req-870fa6fb-2fde-44c8-aa58-61656744b5d5 service nova] Enqueued Resource ID: 3b566d26-410e-4299-a228-21c6329812d0 with Priority: HIGHEST for action port [ 639.887635] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dcd9f79f-c997-4a2d-83a2-472c849b1794 with Priority: HIGHEST for action security_group_rules [ 639.887635] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dcd9f79f-c997-4a2d-83a2-472c849b1794 with Priority: HIGHEST for action security_group_members [ 639.887635] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b566d26-410e-4299-a228-21c6329812d0 with Priority: HIGHEST for action port [ 639.887635] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dcd9f79f-c997-4a2d-83a2-472c849b1794 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.887635] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dcd9f79f-c997-4a2d-83a2-472c849b1794" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.888065] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dcd9f79f-c997-4a2d-83a2-472c849b1794" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.891578] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dcd9f79f-c997-4a2d-83a2-472c849b1794" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.891578] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dcd9f79f-c997-4a2d-83a2-472c849b1794',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.891578] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-dcd9f79f-c997-4a2d-83a2-472c849b1794 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.891578] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dcd9f79f-c997-4a2d-83a2-472c849b1794" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.891578] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-3b566d26-410e-4299-a228-21c6329812d0 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.891578] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3b566d26-410e-4299-a228-21c6329812d0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.891578] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3b566d26-410e-4299-a228-21c6329812d0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.891578] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3b566d26-410e-4299-a228-21c6329812d0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.891578] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3b566d26-410e-4299-a228-21c6329812d0',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.079282] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e268e8f2-4a55-4082-8a7e-cc360c3f6f0a [ 640.079913] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.080392] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.080598] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.081203] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.081533] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.083107] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e268e8f2-4a55-4082-8a7e-cc360c3f6f0a already deleted. [ 640.083107] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e268e8f2-4a55-4082-8a7e-cc360c3f6f0a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.217184] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 06438b8f-6cee-4263-9d4c-43067bbe0a4c: rpc.has_security_group_logging(os_id): False [ 640.241455] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.242135] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.244027] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.244027] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.244027] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.244027] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.244027] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.244027] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.244027] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.244027] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.244027] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 06438b8f-6cee-4263-9d4c-43067bbe0a4c is going to be created. [ 640.250997] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dcd9f79f-c997-4a2d-83a2-472c849b1794',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.316016] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.316016] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.316016] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.316016] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.316016] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.331478] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 06438b8f-6cee-4263-9d4c-43067bbe0a4c in Status: IN_PROGRESS for 2s [ 640.394573] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3b566d26-410e-4299-a228-21c6329812d0 with status ACTIVE [ 640.394898] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.395105] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.395183] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.395529] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.395582] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.395834] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.399948] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.399948] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.399948] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.399948] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.399948] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.399948] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.399948] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.399948] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.399948] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.399948] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3b566d26-410e-4299-a228-21c6329812d0 is going to be updated. [ 640.399948] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-dcd9f79f-c997-4a2d-83a2-472c849b1794 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.399948] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dcd9f79f-c997-4a2d-83a2-472c849b1794" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.433836] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.433984] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.434085] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.434302] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.434472] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.434597] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3b566d26-410e-4299-a228-21c6329812d0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.460610] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock network-225 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.460816] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "network-225" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.460946] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "network-225" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.461242] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "network-225" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.461503] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.461781] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.462197] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.462548] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.462897] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.463194] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 640.463364] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] NeedRegenerationException {{(pid=69232) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 640.463522] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] no value, waiting for create lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 640.463673] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] value creation lock acquired {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 640.463833] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 640.463986] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Calling creation function for not-yet-present value {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 640.464180] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 640.493669] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 640.493890] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=69232) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 640.494105] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Released creation lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 640.494226] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "network-225" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.494565] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock port-628f2591-2785-4641-bbfc-596889ed0394 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.494749] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "port-628f2591-2785-4641-bbfc-596889ed0394" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.494874] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "port-628f2591-2785-4641-bbfc-596889ed0394" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.495308] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "port-628f2591-2785-4641-bbfc-596889ed0394" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.495455] env[69232]: DEBUG networking_nsxv3.api.rpc [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('628f2591-2785-4641-bbfc-596889ed0394',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.753045] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dcd9f79f-c997-4a2d-83a2-472c849b1794',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.989360] env[69232]: INFO networking_nsxv3.common.synchronization [None req-110212ef-b3ad-4c85-a4f0-c6b1758a2e24 tempest-AttachInterfacesUnderV243Test-115986106 tempest-AttachInterfacesUnderV243Test-115986106-project-member] Enqueued Resource ID: 393d1484-2236-4219-a1eb-b4013eec039a with Priority: HIGHEST for action security_group_rules [ 640.989360] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 393d1484-2236-4219-a1eb-b4013eec039a with Priority: HIGHEST for action security_group_rules [ 640.989717] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-393d1484-2236-4219-a1eb-b4013eec039a taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.990061] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-393d1484-2236-4219-a1eb-b4013eec039a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.992581] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-393d1484-2236-4219-a1eb-b4013eec039a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.992581] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-393d1484-2236-4219-a1eb-b4013eec039a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.992581] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('393d1484-2236-4219-a1eb-b4013eec039a',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.002257] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.002257] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.002257] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.002257] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.002257] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.002257] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Segment Port 628f2591-2785-4641-bbfc-596889ed0394 not found, creating... [ 641.002257] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.002257] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.002257] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.002257] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.002257] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.002973] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.003354] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.003623] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.004106] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.004400] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.004689] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Resource: SegmentPort with ID: 628f2591-2785-4641-bbfc-596889ed0394 is going to be created. [ 641.028136] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.028886] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.029426] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.030570] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.030570] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.030570] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "port-628f2591-2785-4641-bbfc-596889ed0394" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.255198] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.255529] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.255529] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.255680] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.255795] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.256085] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dcd9f79f-c997-4a2d-83a2-472c849b1794 is going to be created. [ 641.319508] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.319508] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.319508] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.319508] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.319508] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.330258] env[69232]: INFO networking_nsxv3.common.synchronization [None req-f1037c32-3cb1-496b-9ddc-066c7fa6814e tempest-AttachInterfacesUnderV243Test-115986106 tempest-AttachInterfacesUnderV243Test-115986106-project-member] Enqueued Resource ID: 393d1484-2236-4219-a1eb-b4013eec039a with Priority: HIGHEST for action security_group_rules [ 641.330258] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 393d1484-2236-4219-a1eb-b4013eec039a with Priority: HIGHEST for action security_group_rules [ 641.330845] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-393d1484-2236-4219-a1eb-b4013eec039a taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.330845] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-393d1484-2236-4219-a1eb-b4013eec039a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.332365] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dcd9f79f-c997-4a2d-83a2-472c849b1794 in Status: UNINITIALIZED for 2s [ 641.524893] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.524893] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.524893] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.524893] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.524893] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.524893] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 393d1484-2236-4219-a1eb-b4013eec039a already deleted. [ 641.524893] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-393d1484-2236-4219-a1eb-b4013eec039a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.524893] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-393d1484-2236-4219-a1eb-b4013eec039a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.524893] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-393d1484-2236-4219-a1eb-b4013eec039a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.524893] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('393d1484-2236-4219-a1eb-b4013eec039a',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.806619] env[69232]: INFO networking_nsxv3.common.synchronization [req-12cfb5ce-75f3-4000-872d-74fc420abdd3 req-c8064f97-7030-4335-afcb-f12160ee0aae tempest-SecurityGroupRulesTestJSON-29443989 tempest-SecurityGroupRulesTestJSON-29443989-project-member] Enqueued Resource ID: 6d24abcc-0e2c-4766-8e24-a85b40143f5c with Priority: HIGHEST for action security_group_rules [ 641.807686] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d24abcc-0e2c-4766-8e24-a85b40143f5c with Priority: HIGHEST for action security_group_rules [ 641.810195] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6d24abcc-0e2c-4766-8e24-a85b40143f5c taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.810195] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6d24abcc-0e2c-4766-8e24-a85b40143f5c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.810195] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6d24abcc-0e2c-4766-8e24-a85b40143f5c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.810195] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6d24abcc-0e2c-4766-8e24-a85b40143f5c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.810195] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6d24abcc-0e2c-4766-8e24-a85b40143f5c',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.049230] env[69232]: INFO networking_nsxv3.common.synchronization [None req-0bdca818-9b2d-447c-8a35-ac957d4c7cba None None] Enqueued Resource ID: 9a51e69b-8c84-4b59-9565-e36b0f790dca with Priority: HIGHEST for action port [ 642.051815] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.051977] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.052072] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.052303] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.052398] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.052498] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 393d1484-2236-4219-a1eb-b4013eec039a already deleted. [ 642.052602] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-393d1484-2236-4219-a1eb-b4013eec039a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.053602] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a51e69b-8c84-4b59-9565-e36b0f790dca with Priority: HIGHEST for action port [ 642.053989] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-9a51e69b-8c84-4b59-9565-e36b0f790dca taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.054182] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9a51e69b-8c84-4b59-9565-e36b0f790dca" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.054255] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9a51e69b-8c84-4b59-9565-e36b0f790dca" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.054635] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9a51e69b-8c84-4b59-9565-e36b0f790dca" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.054635] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9a51e69b-8c84-4b59-9565-e36b0f790dca',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.276577] env[69232]: INFO networking_nsxv3.common.synchronization [req-51b36e18-7162-4afa-97ec-cddef1d6c507 req-7b06276d-cb3c-4c73-90f2-750ada9c3b1c service nova] Enqueued Resource ID: dcd9f79f-c997-4a2d-83a2-472c849b1794 with Priority: HIGHEST for action security_group_rules [ 642.284203] env[69232]: INFO networking_nsxv3.common.synchronization [req-51b36e18-7162-4afa-97ec-cddef1d6c507 req-7b06276d-cb3c-4c73-90f2-750ada9c3b1c service nova] Enqueued Resource ID: dcd9f79f-c997-4a2d-83a2-472c849b1794 with Priority: HIGHEST for action security_group_members [ 642.284203] env[69232]: INFO networking_nsxv3.common.synchronization [req-51b36e18-7162-4afa-97ec-cddef1d6c507 req-7b06276d-cb3c-4c73-90f2-750ada9c3b1c service nova] Enqueued Resource ID: 628f2591-2785-4641-bbfc-596889ed0394 with Priority: HIGHEST for action port [ 642.284203] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dcd9f79f-c997-4a2d-83a2-472c849b1794 with Priority: HIGHEST for action security_group_rules [ 642.284203] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dcd9f79f-c997-4a2d-83a2-472c849b1794 with Priority: HIGHEST for action security_group_members [ 642.284203] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 628f2591-2785-4641-bbfc-596889ed0394 with Priority: HIGHEST for action port [ 642.284203] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dcd9f79f-c997-4a2d-83a2-472c849b1794 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.284203] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dcd9f79f-c997-4a2d-83a2-472c849b1794" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.284203] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-dcd9f79f-c997-4a2d-83a2-472c849b1794 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.284203] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dcd9f79f-c997-4a2d-83a2-472c849b1794" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.284203] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-628f2591-2785-4641-bbfc-596889ed0394 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.284203] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-628f2591-2785-4641-bbfc-596889ed0394" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.284203] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-628f2591-2785-4641-bbfc-596889ed0394" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.284203] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-628f2591-2785-4641-bbfc-596889ed0394" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.284203] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('628f2591-2785-4641-bbfc-596889ed0394',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.337639] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.340334] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.340334] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.340334] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.340334] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.340334] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6d24abcc-0e2c-4766-8e24-a85b40143f5c already deleted. [ 642.340334] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6d24abcc-0e2c-4766-8e24-a85b40143f5c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.346147] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 06438b8f-6cee-4263-9d4c-43067bbe0a4c in Status: SUCCESS [ 642.347309] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-06438b8f-6cee-4263-9d4c-43067bbe0a4c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.559965] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9a51e69b-8c84-4b59-9565-e36b0f790dca [ 642.560630] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.560875] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.560977] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.561420] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.561420] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.561532] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9a51e69b-8c84-4b59-9565-e36b0f790dca already deleted. [ 642.561635] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9a51e69b-8c84-4b59-9565-e36b0f790dca" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.726497] env[69232]: INFO networking_nsxv3.common.synchronization [None req-2e47b541-8934-4339-a377-9ce8e407bd8d None None] Enqueued Resource ID: 30581801-2a5c-45e4-a4c3-7869b38c42d8 with Priority: HIGHEST for action port [ 642.726497] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30581801-2a5c-45e4-a4c3-7869b38c42d8 with Priority: HIGHEST for action port [ 642.727091] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-30581801-2a5c-45e4-a4c3-7869b38c42d8 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.727091] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-30581801-2a5c-45e4-a4c3-7869b38c42d8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.727332] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-30581801-2a5c-45e4-a4c3-7869b38c42d8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.728017] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-30581801-2a5c-45e4-a4c3-7869b38c42d8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.728017] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('30581801-2a5c-45e4-a4c3-7869b38c42d8',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.770839] env[69232]: INFO networking_nsxv3.common.synchronization [None req-e4542c1c-4bca-4b5b-9972-51dc5e6d5bed None None] Enqueued Resource ID: 18656a38-d1be-4a2b-b211-adc582fbd6b7 with Priority: HIGHEST for action port [ 642.772035] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18656a38-d1be-4a2b-b211-adc582fbd6b7 with Priority: HIGHEST for action port [ 642.774903] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-18656a38-d1be-4a2b-b211-adc582fbd6b7 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.774995] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-18656a38-d1be-4a2b-b211-adc582fbd6b7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.775112] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-18656a38-d1be-4a2b-b211-adc582fbd6b7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.775406] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-18656a38-d1be-4a2b-b211-adc582fbd6b7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.775495] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('18656a38-d1be-4a2b-b211-adc582fbd6b7',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.789730] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 628f2591-2785-4641-bbfc-596889ed0394 with status ACTIVE [ 642.790038] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.790182] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.790257] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.790478] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.790738] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.790738] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.790880] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.790918] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.791079] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.791156] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.791340] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.795816] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.795816] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.795816] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.795816] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.795816] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 628f2591-2785-4641-bbfc-596889ed0394 is going to be updated. [ 642.826397] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.826397] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.826518] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.826923] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.827140] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.827304] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-628f2591-2785-4641-bbfc-596889ed0394" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.231603] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 30581801-2a5c-45e4-a4c3-7869b38c42d8 [ 643.231603] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.231603] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.231603] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.231603] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.232434] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.232434] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:30581801-2a5c-45e4-a4c3-7869b38c42d8 already deleted. [ 643.232434] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-30581801-2a5c-45e4-a4c3-7869b38c42d8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.281180] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 18656a38-d1be-4a2b-b211-adc582fbd6b7 [ 643.281180] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.281180] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.281180] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.281180] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.281180] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.281180] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:18656a38-d1be-4a2b-b211-adc582fbd6b7 already deleted. [ 643.281180] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-18656a38-d1be-4a2b-b211-adc582fbd6b7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.343484] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dcd9f79f-c997-4a2d-83a2-472c849b1794 in Status: SUCCESS [ 643.343795] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dcd9f79f-c997-4a2d-83a2-472c849b1794" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.343890] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dcd9f79f-c997-4a2d-83a2-472c849b1794" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.344135] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dcd9f79f-c997-4a2d-83a2-472c849b1794" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.347754] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.347754] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.347754] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.347754] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.347754] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.347754] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dcd9f79f-c997-4a2d-83a2-472c849b1794',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.438102] env[69232]: INFO networking_nsxv3.common.synchronization [req-e336a1e1-e1f0-4948-bd49-b20053f1b365 req-18a138b7-7a01-47b6-9d96-5916d3a3c8f3 tempest-SecurityGroupRulesNegativeTestJSON-1171045311 tempest-SecurityGroupRulesNegativeTestJSON-1171045311-project-member] Enqueued Resource ID: 9ca51cdf-3d32-4489-8dbf-ad77541a5a78 with Priority: HIGHEST for action security_group_rules [ 643.438657] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ca51cdf-3d32-4489-8dbf-ad77541a5a78 with Priority: HIGHEST for action security_group_rules [ 643.440021] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9ca51cdf-3d32-4489-8dbf-ad77541a5a78 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.440221] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9ca51cdf-3d32-4489-8dbf-ad77541a5a78" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.440264] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9ca51cdf-3d32-4489-8dbf-ad77541a5a78" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.440517] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9ca51cdf-3d32-4489-8dbf-ad77541a5a78" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.440603] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9ca51cdf-3d32-4489-8dbf-ad77541a5a78',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.784052] env[69232]: INFO networking_nsxv3.common.synchronization [req-2373667f-00cb-45c1-96cd-7c371787244c req-5da01ab8-6afa-4bf1-8ca3-64d455c4c080 tempest-ServerDiagnosticsTest-552915207 tempest-ServerDiagnosticsTest-552915207-project-member] Enqueued Resource ID: aa535b82-e1cd-4d4a-9994-f97b75b51d5e with Priority: HIGHEST for action security_group_members [ 643.785071] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa535b82-e1cd-4d4a-9994-f97b75b51d5e with Priority: HIGHEST for action security_group_members [ 643.785071] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa535b82-e1cd-4d4a-9994-f97b75b51d5e taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.785071] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa535b82-e1cd-4d4a-9994-f97b75b51d5e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.788647] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa535b82-e1cd-4d4a-9994-f97b75b51d5e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.790463] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa535b82-e1cd-4d4a-9994-f97b75b51d5e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.790463] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.790463] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.790463] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.790463] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.790463] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.790463] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa535b82-e1cd-4d4a-9994-f97b75b51d5e',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.847137] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dcd9f79f-c997-4a2d-83a2-472c849b1794',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.967256] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.967256] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.967520] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.967656] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.967968] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.967968] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9ca51cdf-3d32-4489-8dbf-ad77541a5a78 already deleted. [ 643.967968] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9ca51cdf-3d32-4489-8dbf-ad77541a5a78" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.204746] env[69232]: INFO networking_nsxv3.common.synchronization [None req-1e65df15-4b13-4b24-b283-2bf74662e651 tempest-VolumesAdminNegativeTest-609403025 tempest-VolumesAdminNegativeTest-609403025-project-member] Enqueued Resource ID: 453650db-0c42-4224-8f26-d113b3aaa020 with Priority: HIGHEST for action security_group_rules [ 644.205715] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 453650db-0c42-4224-8f26-d113b3aaa020 with Priority: HIGHEST for action security_group_rules [ 644.206046] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-453650db-0c42-4224-8f26-d113b3aaa020 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.206178] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-453650db-0c42-4224-8f26-d113b3aaa020" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.206529] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-453650db-0c42-4224-8f26-d113b3aaa020" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.207293] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-453650db-0c42-4224-8f26-d113b3aaa020" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.207407] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('453650db-0c42-4224-8f26-d113b3aaa020',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.293188] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.293636] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.293636] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.293636] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.293740] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.294232] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.294232] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.294232] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.294232] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.294462] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.294462] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa535b82-e1cd-4d4a-9994-f97b75b51d5e is going to be updated. [ 644.341686] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.341950] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.341950] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.342139] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.342289] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.350875] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dcd9f79f-c997-4a2d-83a2-472c849b1794',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.355092] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa535b82-e1cd-4d4a-9994-f97b75b51d5e in Status: IN_PROGRESS for 2s [ 644.412746] env[69232]: INFO networking_nsxv3.common.synchronization [None req-ed1fdbe5-b218-48c7-adc3-b1501691027a tempest-VolumesAdminNegativeTest-609403025 tempest-VolumesAdminNegativeTest-609403025-project-member] Enqueued Resource ID: 453650db-0c42-4224-8f26-d113b3aaa020 with Priority: HIGHEST for action security_group_rules [ 644.413480] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 453650db-0c42-4224-8f26-d113b3aaa020 with Priority: HIGHEST for action security_group_rules [ 644.417798] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-453650db-0c42-4224-8f26-d113b3aaa020 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.418011] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-453650db-0c42-4224-8f26-d113b3aaa020" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.507734] env[69232]: INFO networking_nsxv3.common.synchronization [req-0d282be4-5f33-4ef8-a046-9a7736150e2c req-284ace94-7c46-49a8-9473-a04d8435c282 tempest-AttachInterfacesTestJSON-1442903876 tempest-AttachInterfacesTestJSON-1442903876-project-member] Enqueued Resource ID: 36cbe3ea-321a-4c5f-b46b-f3297d4ccb49 with Priority: HIGHEST for action security_group_members [ 644.507734] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 36cbe3ea-321a-4c5f-b46b-f3297d4ccb49 with Priority: HIGHEST for action security_group_members [ 644.507734] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-36cbe3ea-321a-4c5f-b46b-f3297d4ccb49 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.507734] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-36cbe3ea-321a-4c5f-b46b-f3297d4ccb49" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.507734] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-36cbe3ea-321a-4c5f-b46b-f3297d4ccb49" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.507734] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-36cbe3ea-321a-4c5f-b46b-f3297d4ccb49" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.507734] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.507734] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.507734] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.510287] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.510287] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.510287] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('36cbe3ea-321a-4c5f-b46b-f3297d4ccb49',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.737325] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.737325] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.737325] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.737325] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.737325] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.737325] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 453650db-0c42-4224-8f26-d113b3aaa020 already deleted. [ 644.737325] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-453650db-0c42-4224-8f26-d113b3aaa020" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.737325] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-453650db-0c42-4224-8f26-d113b3aaa020" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.737325] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-453650db-0c42-4224-8f26-d113b3aaa020" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.737325] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('453650db-0c42-4224-8f26-d113b3aaa020',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.768295] env[69232]: INFO networking_nsxv3.common.synchronization [None req-2ba04ae4-039c-431c-9d9b-e04fb866f3c4 None None] Enqueued Resource ID: 658346a5-7424-4258-a3bb-11a14013875d with Priority: HIGHEST for action port [ 644.768295] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 658346a5-7424-4258-a3bb-11a14013875d with Priority: HIGHEST for action port [ 644.769226] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-658346a5-7424-4258-a3bb-11a14013875d taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.769226] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-658346a5-7424-4258-a3bb-11a14013875d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.769584] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-658346a5-7424-4258-a3bb-11a14013875d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.769584] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-658346a5-7424-4258-a3bb-11a14013875d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.770173] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('658346a5-7424-4258-a3bb-11a14013875d',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.854357] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.855093] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.857756] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.857756] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.857756] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.857756] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dcd9f79f-c997-4a2d-83a2-472c849b1794 is going to be updated. [ 644.885304] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.885486] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.885486] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.885648] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.886227] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.900076] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dcd9f79f-c997-4a2d-83a2-472c849b1794 in Status: IN_PROGRESS for 2s [ 645.016990] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.016990] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.016990] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.017471] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.017471] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.017471] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.017471] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.017653] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.017685] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.017767] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.017932] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 36cbe3ea-321a-4c5f-b46b-f3297d4ccb49 already deleted. [ 645.017932] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-36cbe3ea-321a-4c5f-b46b-f3297d4ccb49" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.116789] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock network-756 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.116789] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "network-756" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.116789] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "network-756" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.116789] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "network-756" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.116789] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.116789] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.116789] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.116789] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.116789] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.116789] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 645.116789] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] NeedRegenerationException {{(pid=69232) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 645.116789] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] no value, waiting for create lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 645.116789] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] value creation lock acquired {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 645.119168] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 645.119168] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Calling creation function for not-yet-present value {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 645.119168] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 645.142113] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 645.142716] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=69232) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 645.142716] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Released creation lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 645.142716] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "network-756" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.143118] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock port-54facc54-7f1a-4936-b27d-6fcd40a2e5a1 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.143424] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "port-54facc54-7f1a-4936-b27d-6fcd40a2e5a1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.143694] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "port-54facc54-7f1a-4936-b27d-6fcd40a2e5a1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.144321] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "port-54facc54-7f1a-4936-b27d-6fcd40a2e5a1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.144524] env[69232]: DEBUG networking_nsxv3.api.rpc [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('54facc54-7f1a-4936-b27d-6fcd40a2e5a1',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.267988] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.267988] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.267988] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.268696] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.268939] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.269233] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 453650db-0c42-4224-8f26-d113b3aaa020 already deleted. [ 645.269430] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-453650db-0c42-4224-8f26-d113b3aaa020" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.271905] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 658346a5-7424-4258-a3bb-11a14013875d [ 645.272069] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.272198] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.272526] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.272971] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.273061] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.273188] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:658346a5-7424-4258-a3bb-11a14013875d already deleted. [ 645.273188] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-658346a5-7424-4258-a3bb-11a14013875d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.647326] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.647698] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.647698] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.647941] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.648106] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.648260] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Segment Port 54facc54-7f1a-4936-b27d-6fcd40a2e5a1 not found, creating... [ 645.649093] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.649093] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.649093] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.649292] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.649292] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.649586] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.649742] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.649880] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.655762] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.655762] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.655762] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Resource: SegmentPort with ID: 54facc54-7f1a-4936-b27d-6fcd40a2e5a1 is going to be created. [ 645.678965] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.679225] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.679348] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.679630] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.679870] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.680202] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "port-54facc54-7f1a-4936-b27d-6fcd40a2e5a1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.687569] env[69232]: INFO networking_nsxv3.common.synchronization [None req-e8413d3b-e2c5-44a9-956f-88f58c565159 None None] Enqueued Resource ID: 87bf0773-c984-4003-88e4-424530667558 with Priority: HIGHEST for action port [ 645.687569] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 87bf0773-c984-4003-88e4-424530667558 with Priority: HIGHEST for action port [ 645.687569] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-87bf0773-c984-4003-88e4-424530667558 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.687569] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-87bf0773-c984-4003-88e4-424530667558" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.687569] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-87bf0773-c984-4003-88e4-424530667558" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.687569] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-87bf0773-c984-4003-88e4-424530667558" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.687569] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('87bf0773-c984-4003-88e4-424530667558',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.190157] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 87bf0773-c984-4003-88e4-424530667558 [ 646.190436] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.190436] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.190631] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.190955] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.191198] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.191310] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:87bf0773-c984-4003-88e4-424530667558 already deleted. [ 646.191734] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-87bf0773-c984-4003-88e4-424530667558" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.365735] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa535b82-e1cd-4d4a-9994-f97b75b51d5e in Status: SUCCESS [ 646.365905] env[69232]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa535b82-e1cd-4d4a-9994-f97b75b51d5e deletion is rescheduled due to dependency. [ 646.366030] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa535b82-e1cd-4d4a-9994-f97b75b51d5e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.705405] env[69232]: INFO networking_nsxv3.common.synchronization [req-0d282be4-5f33-4ef8-a046-9a7736150e2c req-b1c73f99-7e55-42cf-912e-f3acba6261bf service nova] Enqueued Resource ID: 36cbe3ea-321a-4c5f-b46b-f3297d4ccb49 with Priority: HIGHEST for action security_group_rules [ 646.705405] env[69232]: INFO networking_nsxv3.common.synchronization [req-0d282be4-5f33-4ef8-a046-9a7736150e2c req-b1c73f99-7e55-42cf-912e-f3acba6261bf service nova] Enqueued Resource ID: 36cbe3ea-321a-4c5f-b46b-f3297d4ccb49 with Priority: HIGHEST for action security_group_members [ 646.705405] env[69232]: INFO networking_nsxv3.common.synchronization [req-0d282be4-5f33-4ef8-a046-9a7736150e2c req-b1c73f99-7e55-42cf-912e-f3acba6261bf service nova] Enqueued Resource ID: 54facc54-7f1a-4936-b27d-6fcd40a2e5a1 with Priority: HIGHEST for action port [ 646.705796] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 36cbe3ea-321a-4c5f-b46b-f3297d4ccb49 with Priority: HIGHEST for action security_group_rules [ 646.705796] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 36cbe3ea-321a-4c5f-b46b-f3297d4ccb49 with Priority: HIGHEST for action security_group_members [ 646.705796] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54facc54-7f1a-4936-b27d-6fcd40a2e5a1 with Priority: HIGHEST for action port [ 646.706975] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-36cbe3ea-321a-4c5f-b46b-f3297d4ccb49 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.707717] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-36cbe3ea-321a-4c5f-b46b-f3297d4ccb49" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.707717] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-36cbe3ea-321a-4c5f-b46b-f3297d4ccb49" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.707717] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-36cbe3ea-321a-4c5f-b46b-f3297d4ccb49" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.707717] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('36cbe3ea-321a-4c5f-b46b-f3297d4ccb49',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.713488] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-36cbe3ea-321a-4c5f-b46b-f3297d4ccb49 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.713488] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-36cbe3ea-321a-4c5f-b46b-f3297d4ccb49" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.713488] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-36cbe3ea-321a-4c5f-b46b-f3297d4ccb49" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.714280] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-36cbe3ea-321a-4c5f-b46b-f3297d4ccb49" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.714280] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.714280] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.714280] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.714280] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.714644] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.714644] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('36cbe3ea-321a-4c5f-b46b-f3297d4ccb49',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.715769] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-54facc54-7f1a-4936-b27d-6fcd40a2e5a1 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.716097] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-54facc54-7f1a-4936-b27d-6fcd40a2e5a1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.716176] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-54facc54-7f1a-4936-b27d-6fcd40a2e5a1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.718838] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-54facc54-7f1a-4936-b27d-6fcd40a2e5a1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.718936] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('54facc54-7f1a-4936-b27d-6fcd40a2e5a1',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.763651] env[69232]: INFO networking_nsxv3.common.synchronization [req-01b5896e-813e-474a-b118-1e9c9cea1706 req-f77b1fdb-de45-439b-9f6f-3ce553e44784 tempest-ServerTagsTestJSON-1644553538 tempest-ServerTagsTestJSON-1644553538-project-member] Enqueued Resource ID: 131f51ef-2833-4453-914e-c87497d66ff6 with Priority: HIGHEST for action security_group_members [ 646.764333] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 131f51ef-2833-4453-914e-c87497d66ff6 with Priority: HIGHEST for action security_group_members [ 646.764742] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-131f51ef-2833-4453-914e-c87497d66ff6 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.765025] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-131f51ef-2833-4453-914e-c87497d66ff6" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.765025] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-131f51ef-2833-4453-914e-c87497d66ff6" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.765522] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-131f51ef-2833-4453-914e-c87497d66ff6" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.765846] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.765846] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.765846] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.766937] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.766937] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.766937] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('131f51ef-2833-4453-914e-c87497d66ff6',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.913343] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dcd9f79f-c997-4a2d-83a2-472c849b1794 in Status: SUCCESS [ 646.913343] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dcd9f79f-c997-4a2d-83a2-472c849b1794" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.913343] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dcd9f79f-c997-4a2d-83a2-472c849b1794" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.913593] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dcd9f79f-c997-4a2d-83a2-472c849b1794" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.913685] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.914018] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.914018] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.914186] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.914186] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.914245] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dcd9f79f-c997-4a2d-83a2-472c849b1794" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.914671] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dcd9f79f-c997-4a2d-83a2-472c849b1794',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.915476] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dcd9f79f-c997-4a2d-83a2-472c849b1794" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.915560] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dcd9f79f-c997-4a2d-83a2-472c849b1794" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.915699] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.915990] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.915990] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.918522] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.918522] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.918522] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dcd9f79f-c997-4a2d-83a2-472c849b1794',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.146478] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock network-571 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.146478] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "network-571" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.146478] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "network-571" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.147822] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "network-571" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.147822] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.147822] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.147822] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.148090] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.148260] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.148521] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 647.148589] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] NeedRegenerationException {{(pid=69232) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 647.148759] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] no value, waiting for create lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 647.148848] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] value creation lock acquired {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 647.148912] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 647.149657] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Calling creation function for not-yet-present value {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 647.149657] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 647.172822] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 647.172822] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69232) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 647.172822] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Released creation lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 647.172822] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "network-571" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.173170] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock port-f93b5de8-a328-425b-b1e0-7695e60a2b6e taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.173342] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "port-f93b5de8-a328-425b-b1e0-7695e60a2b6e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.173454] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "port-f93b5de8-a328-425b-b1e0-7695e60a2b6e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.174521] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "port-f93b5de8-a328-425b-b1e0-7695e60a2b6e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.174787] env[69232]: DEBUG networking_nsxv3.api.rpc [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f93b5de8-a328-425b-b1e0-7695e60a2b6e',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.221898] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('36cbe3ea-321a-4c5f-b46b-f3297d4ccb49',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.222229] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-36cbe3ea-321a-4c5f-b46b-f3297d4ccb49 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.222384] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-36cbe3ea-321a-4c5f-b46b-f3297d4ccb49" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.226336] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 54facc54-7f1a-4936-b27d-6fcd40a2e5a1 with status ACTIVE [ 647.226454] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.226589] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.226657] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.226904] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.227093] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.227336] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.227443] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.227515] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.227674] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.227767] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.227998] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.228098] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.228141] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.228287] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.228358] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.228442] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 54facc54-7f1a-4936-b27d-6fcd40a2e5a1 is going to be updated. [ 647.262032] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.262032] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.262032] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.262032] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.262032] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.262032] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-54facc54-7f1a-4936-b27d-6fcd40a2e5a1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.273668] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.273668] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.273668] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.273668] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.273668] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.273668] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.273668] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.273668] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.273668] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.273668] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.276595] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 131f51ef-2833-4453-914e-c87497d66ff6 already deleted. [ 647.276595] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-131f51ef-2833-4453-914e-c87497d66ff6" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.421696] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-dcd9f79f-c997-4a2d-83a2-472c849b1794 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.421959] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dcd9f79f-c997-4a2d-83a2-472c849b1794" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.423464] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dcd9f79f-c997-4a2d-83a2-472c849b1794',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.678181] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.680280] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.680280] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.680280] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.680280] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.680280] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Segment Port f93b5de8-a328-425b-b1e0-7695e60a2b6e not found, creating... [ 647.680280] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.680544] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.680544] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.681957] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.682215] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.682630] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.682844] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.683017] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.683652] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.683933] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.684076] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Resource: SegmentPort with ID: f93b5de8-a328-425b-b1e0-7695e60a2b6e is going to be created. [ 647.710901] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.710901] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.710901] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.710901] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.710901] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.710901] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "port-f93b5de8-a328-425b-b1e0-7695e60a2b6e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.724531] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('36cbe3ea-321a-4c5f-b46b-f3297d4ccb49',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.925881] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dcd9f79f-c997-4a2d-83a2-472c849b1794',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.232017] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.232017] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.232017] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.232017] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.232017] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.232017] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 36cbe3ea-321a-4c5f-b46b-f3297d4ccb49 is going to be created. [ 648.264024] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.264024] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.264024] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.264024] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.264024] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.277110] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 36cbe3ea-321a-4c5f-b46b-f3297d4ccb49 in Status: UNINITIALIZED for 2s [ 648.431800] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.431800] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.431800] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.431800] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.431800] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.431800] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dcd9f79f-c997-4a2d-83a2-472c849b1794 is going to be updated. [ 648.502032] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.502032] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.502032] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.502032] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.502032] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.516317] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dcd9f79f-c997-4a2d-83a2-472c849b1794 in Status: IN_PROGRESS for 2s [ 648.627504] env[69232]: INFO networking_nsxv3.common.synchronization [req-319f2b1a-a3f2-4cd5-8410-e21b98ab8c3a req-95e2ce82-f17d-4689-8355-3dc9cdb880b1 tempest-ServerExternalEventsTest-756365759 tempest-ServerExternalEventsTest-756365759-project-member] Enqueued Resource ID: 59f751d0-35f1-46f2-bae9-2c23df6749c4 with Priority: HIGHEST for action security_group_members [ 648.629830] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 59f751d0-35f1-46f2-bae9-2c23df6749c4 with Priority: HIGHEST for action security_group_members [ 648.629830] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-59f751d0-35f1-46f2-bae9-2c23df6749c4 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.629830] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-59f751d0-35f1-46f2-bae9-2c23df6749c4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.629830] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-59f751d0-35f1-46f2-bae9-2c23df6749c4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.629830] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-59f751d0-35f1-46f2-bae9-2c23df6749c4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.629830] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.629830] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.629830] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.629830] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.629830] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.630255] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('59f751d0-35f1-46f2-bae9-2c23df6749c4',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.679264] env[69232]: INFO networking_nsxv3.common.synchronization [req-01b5896e-813e-474a-b118-1e9c9cea1706 req-f543fec2-bbef-43c3-b247-e243abd7fef8 service nova] Enqueued Resource ID: 131f51ef-2833-4453-914e-c87497d66ff6 with Priority: HIGHEST for action security_group_rules [ 648.679438] env[69232]: INFO networking_nsxv3.common.synchronization [req-01b5896e-813e-474a-b118-1e9c9cea1706 req-f543fec2-bbef-43c3-b247-e243abd7fef8 service nova] Enqueued Resource ID: 131f51ef-2833-4453-914e-c87497d66ff6 with Priority: HIGHEST for action security_group_members [ 648.679575] env[69232]: INFO networking_nsxv3.common.synchronization [req-01b5896e-813e-474a-b118-1e9c9cea1706 req-f543fec2-bbef-43c3-b247-e243abd7fef8 service nova] Enqueued Resource ID: f93b5de8-a328-425b-b1e0-7695e60a2b6e with Priority: HIGHEST for action port [ 648.681164] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 131f51ef-2833-4453-914e-c87497d66ff6 with Priority: HIGHEST for action security_group_rules [ 648.681164] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 131f51ef-2833-4453-914e-c87497d66ff6 with Priority: HIGHEST for action security_group_members [ 648.681164] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f93b5de8-a328-425b-b1e0-7695e60a2b6e with Priority: HIGHEST for action port [ 648.681164] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-131f51ef-2833-4453-914e-c87497d66ff6 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.681164] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-131f51ef-2833-4453-914e-c87497d66ff6" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.681164] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-131f51ef-2833-4453-914e-c87497d66ff6" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.684904] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-131f51ef-2833-4453-914e-c87497d66ff6" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.685079] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('131f51ef-2833-4453-914e-c87497d66ff6',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.688917] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-131f51ef-2833-4453-914e-c87497d66ff6 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.688917] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-131f51ef-2833-4453-914e-c87497d66ff6" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.688917] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-131f51ef-2833-4453-914e-c87497d66ff6" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.689750] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-131f51ef-2833-4453-914e-c87497d66ff6" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.689750] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.689750] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.689750] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.690535] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.690742] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.690953] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('131f51ef-2833-4453-914e-c87497d66ff6',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.694411] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-f93b5de8-a328-425b-b1e0-7695e60a2b6e taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.695425] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f93b5de8-a328-425b-b1e0-7695e60a2b6e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.695425] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f93b5de8-a328-425b-b1e0-7695e60a2b6e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.695425] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f93b5de8-a328-425b-b1e0-7695e60a2b6e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.695425] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f93b5de8-a328-425b-b1e0-7695e60a2b6e',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.132711] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.133351] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.133351] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.133351] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.133491] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.134242] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.134242] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.134242] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.134242] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.134242] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.134242] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 59f751d0-35f1-46f2-bae9-2c23df6749c4 is going to be updated. [ 649.138791] env[69232]: INFO networking_nsxv3.common.synchronization [req-fc49db8d-195a-4595-9845-f438acf1a7de req-cc951796-23f6-4ee5-9519-10464a7847ff tempest-SecurityGroupRulesNegativeTestJSON-1171045311 tempest-SecurityGroupRulesNegativeTestJSON-1171045311-project-member] Enqueued Resource ID: 9ca51cdf-3d32-4489-8dbf-ad77541a5a78 with Priority: HIGHEST for action security_group_rules [ 649.141100] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ca51cdf-3d32-4489-8dbf-ad77541a5a78 with Priority: HIGHEST for action security_group_rules [ 649.141100] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9ca51cdf-3d32-4489-8dbf-ad77541a5a78 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.142093] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9ca51cdf-3d32-4489-8dbf-ad77541a5a78" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.142211] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9ca51cdf-3d32-4489-8dbf-ad77541a5a78" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.142461] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9ca51cdf-3d32-4489-8dbf-ad77541a5a78" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.143104] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9ca51cdf-3d32-4489-8dbf-ad77541a5a78',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.190290] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-131f51ef-2833-4453-914e-c87497d66ff6 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.190290] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-131f51ef-2833-4453-914e-c87497d66ff6" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.198557] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('131f51ef-2833-4453-914e-c87497d66ff6',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.199478] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f93b5de8-a328-425b-b1e0-7695e60a2b6e with status ACTIVE [ 649.200970] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.200970] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.200970] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.200970] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.200970] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.200970] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.200970] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.200970] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.200970] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.202244] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.202488] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.202605] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.202693] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.203720] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.203720] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.203720] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f93b5de8-a328-425b-b1e0-7695e60a2b6e is going to be updated. [ 649.208126] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.208126] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.208126] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.208126] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.208126] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.231507] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 59f751d0-35f1-46f2-bae9-2c23df6749c4 in Status: IN_PROGRESS for 2s [ 649.240679] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.241468] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.241468] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.241468] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.241468] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.241716] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f93b5de8-a328-425b-b1e0-7695e60a2b6e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.676012] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.676619] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.677561] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.677975] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.678206] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.678410] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9ca51cdf-3d32-4489-8dbf-ad77541a5a78 already deleted. [ 649.678584] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9ca51cdf-3d32-4489-8dbf-ad77541a5a78" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.705567] env[69232]: INFO networking_nsxv3.common.synchronization [req-85b71b58-1f2d-429d-9b21-eb1cdc8c8a52 req-648c5409-3e72-45f4-a73a-e969e186e4a9 tempest-AttachInterfacesV270Test-801604483 tempest-AttachInterfacesV270Test-801604483-project-member] Enqueued Resource ID: 9863f261-b349-427a-acad-78b2e3cc35a0 with Priority: HIGHEST for action security_group_members [ 649.706717] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('131f51ef-2833-4453-914e-c87497d66ff6',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.707220] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9863f261-b349-427a-acad-78b2e3cc35a0 with Priority: HIGHEST for action security_group_members [ 649.707867] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-9863f261-b349-427a-acad-78b2e3cc35a0 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.707867] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9863f261-b349-427a-acad-78b2e3cc35a0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.707867] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9863f261-b349-427a-acad-78b2e3cc35a0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.708082] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9863f261-b349-427a-acad-78b2e3cc35a0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.708187] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.708301] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.708351] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.708513] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.708603] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.708694] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9863f261-b349-427a-acad-78b2e3cc35a0',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.212635] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.213071] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.213071] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.213299] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.214583] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.214583] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 131f51ef-2833-4453-914e-c87497d66ff6 is going to be created. [ 650.215691] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.215873] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.215985] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.216524] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.216640] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.216943] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.217077] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.217140] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.217360] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.218820] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.218820] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9863f261-b349-427a-acad-78b2e3cc35a0 already deleted. [ 650.218820] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9863f261-b349-427a-acad-78b2e3cc35a0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.248877] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.248877] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.248877] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.248877] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.249784] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.264033] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 131f51ef-2833-4453-914e-c87497d66ff6 in Status: UNINITIALIZED for 2s [ 650.287302] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 36cbe3ea-321a-4c5f-b46b-f3297d4ccb49 in Status: SUCCESS [ 650.287302] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-36cbe3ea-321a-4c5f-b46b-f3297d4ccb49" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.287302] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-36cbe3ea-321a-4c5f-b46b-f3297d4ccb49" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.287302] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-36cbe3ea-321a-4c5f-b46b-f3297d4ccb49" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.287566] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.287566] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.294839] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.294839] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.294839] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.294839] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-36cbe3ea-321a-4c5f-b46b-f3297d4ccb49" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.294839] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('36cbe3ea-321a-4c5f-b46b-f3297d4ccb49',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.528461] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dcd9f79f-c997-4a2d-83a2-472c849b1794 in Status: SUCCESS [ 650.528738] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dcd9f79f-c997-4a2d-83a2-472c849b1794" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.529333] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dcd9f79f-c997-4a2d-83a2-472c849b1794" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.529333] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dcd9f79f-c997-4a2d-83a2-472c849b1794" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.529333] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.529476] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.529476] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.529611] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.529782] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.529782] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dcd9f79f-c997-4a2d-83a2-472c849b1794" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.529986] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-dcd9f79f-c997-4a2d-83a2-472c849b1794 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.530139] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dcd9f79f-c997-4a2d-83a2-472c849b1794" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.530139] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dcd9f79f-c997-4a2d-83a2-472c849b1794" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.530247] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dcd9f79f-c997-4a2d-83a2-472c849b1794" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.530356] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.530449] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.530503] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.530638] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.530709] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.530788] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dcd9f79f-c997-4a2d-83a2-472c849b1794" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.530876] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dcd9f79f-c997-4a2d-83a2-472c849b1794',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.570079] env[69232]: INFO networking_nsxv3.common.synchronization [req-0d3309d0-d1b5-4032-b57e-881914966a76 req-95d71f2c-0aeb-422c-bd9f-c0701874203a tempest-SecurityGroupRulesTestJSON-29443989 tempest-SecurityGroupRulesTestJSON-29443989-project-member] Enqueued Resource ID: 2b38864c-c67f-44b8-862a-e25f43984764 with Priority: HIGHEST for action security_group_rules [ 650.570079] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b38864c-c67f-44b8-862a-e25f43984764 with Priority: HIGHEST for action security_group_rules [ 650.570079] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2b38864c-c67f-44b8-862a-e25f43984764 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.570079] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2b38864c-c67f-44b8-862a-e25f43984764" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.570079] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2b38864c-c67f-44b8-862a-e25f43984764" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.570079] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2b38864c-c67f-44b8-862a-e25f43984764" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.570079] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2b38864c-c67f-44b8-862a-e25f43984764',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.746009] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock network-321 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.746273] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "network-321" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.746398] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "network-321" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.746772] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "network-321" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.751130] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.751130] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.751130] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.751130] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.751130] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.751130] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 650.751130] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] NeedRegenerationException {{(pid=69232) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 650.751130] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] no value, waiting for create lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 650.751130] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] value creation lock acquired {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 650.751130] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 650.751130] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Calling creation function for not-yet-present value {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 650.751130] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 650.773161] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 650.773401] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69232) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 650.773642] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Released creation lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 650.773853] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "network-321" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.774414] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock port-29f0a744-055e-4983-a39e-54c2cc9490e1 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.774660] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "port-29f0a744-055e-4983-a39e-54c2cc9490e1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.774844] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "port-29f0a744-055e-4983-a39e-54c2cc9490e1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.779188] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "port-29f0a744-055e-4983-a39e-54c2cc9490e1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.779188] env[69232]: DEBUG networking_nsxv3.api.rpc [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('29f0a744-055e-4983-a39e-54c2cc9490e1',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.793058] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('36cbe3ea-321a-4c5f-b46b-f3297d4ccb49',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.035201] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dcd9f79f-c997-4a2d-83a2-472c849b1794: rpc.has_security_group_logging(os_id): False [ 651.059400] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.059588] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.059636] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.060038] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.060100] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.060679] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.060679] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.060679] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.060679] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.060679] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.060936] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.060936] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.060936] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.061117] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.061152] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.061349] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.061478] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.061538] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.061662] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.061739] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.061825] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dcd9f79f-c997-4a2d-83a2-472c849b1794 is going to be created. [ 651.102231] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.102442] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.102532] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.104320] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.104320] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.104320] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2b38864c-c67f-44b8-862a-e25f43984764 already deleted. [ 651.104320] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2b38864c-c67f-44b8-862a-e25f43984764" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.150743] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.151033] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.151150] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.151487] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.151798] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.194023] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dcd9f79f-c997-4a2d-83a2-472c849b1794 in Status: IN_PROGRESS for 2s [ 651.256095] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 59f751d0-35f1-46f2-bae9-2c23df6749c4 in Status: SUCCESS [ 651.256487] env[69232]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 59f751d0-35f1-46f2-bae9-2c23df6749c4 deletion is rescheduled due to dependency. [ 651.256583] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-59f751d0-35f1-46f2-bae9-2c23df6749c4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.281855] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.282151] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.282353] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.282809] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.282923] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.283204] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Segment Port 29f0a744-055e-4983-a39e-54c2cc9490e1 not found, creating... [ 651.283417] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.285286] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.285453] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.285747] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.286463] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.286463] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.286692] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.286792] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.287076] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.287229] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.287380] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Resource: SegmentPort with ID: 29f0a744-055e-4983-a39e-54c2cc9490e1 is going to be created. [ 651.295273] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 36cbe3ea-321a-4c5f-b46b-f3297d4ccb49: rpc.has_security_group_logging(os_id): False [ 651.327399] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.327708] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.327847] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.328243] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.328516] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.328792] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "port-29f0a744-055e-4983-a39e-54c2cc9490e1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.330615] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.330775] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.330824] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.331065] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.331225] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.331532] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.331643] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.331795] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.331962] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.332064] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.332163] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 36cbe3ea-321a-4c5f-b46b-f3297d4ccb49 is going to be created. [ 651.449328] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.449425] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.449565] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.449905] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.450130] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.466505] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 36cbe3ea-321a-4c5f-b46b-f3297d4ccb49 in Status: IN_PROGRESS for 2s [ 651.873302] env[69232]: INFO networking_nsxv3.common.synchronization [req-7d22723e-f921-4a11-8cba-c6a36f201555 req-bdb76cbe-fefb-4675-b334-6e921a1de438 tempest-ImagesOneServerTestJSON-1049093456 tempest-ImagesOneServerTestJSON-1049093456-project-member] Enqueued Resource ID: abd587ac-a2db-4962-b166-638ba1590646 with Priority: HIGHEST for action security_group_members [ 651.874578] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: abd587ac-a2db-4962-b166-638ba1590646 with Priority: HIGHEST for action security_group_members [ 651.874578] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-abd587ac-a2db-4962-b166-638ba1590646 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.874578] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-abd587ac-a2db-4962-b166-638ba1590646" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.874578] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-abd587ac-a2db-4962-b166-638ba1590646" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.874578] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-abd587ac-a2db-4962-b166-638ba1590646" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.874578] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.874811] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.874811] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.874876] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.875204] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.875204] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('abd587ac-a2db-4962-b166-638ba1590646',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.197678] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock network-951 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.197936] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "network-951" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.198122] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "network-951" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.199486] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "network-951" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.199486] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.199486] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.199486] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.199800] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.200416] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.200496] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 652.200589] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] NeedRegenerationException {{(pid=69232) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 652.200789] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] no value, waiting for create lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 652.200921] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] value creation lock acquired {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 652.201194] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 652.201379] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Calling creation function for not-yet-present value {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 652.202235] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 652.225132] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 652.225132] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69232) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 652.225132] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Released creation lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 652.226086] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "network-951" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.228403] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock port-d348dd5f-ac2d-4111-8a23-07bf01dcd360 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.229060] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "port-d348dd5f-ac2d-4111-8a23-07bf01dcd360" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.229235] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "port-d348dd5f-ac2d-4111-8a23-07bf01dcd360" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.229793] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "port-d348dd5f-ac2d-4111-8a23-07bf01dcd360" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.230256] env[69232]: DEBUG networking_nsxv3.api.rpc [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d348dd5f-ac2d-4111-8a23-07bf01dcd360',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.281541] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 131f51ef-2833-4453-914e-c87497d66ff6 in Status: SUCCESS [ 652.281837] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-131f51ef-2833-4453-914e-c87497d66ff6" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.281936] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-131f51ef-2833-4453-914e-c87497d66ff6" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.282219] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-131f51ef-2833-4453-914e-c87497d66ff6" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.282420] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.282545] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.282614] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.282787] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.282870] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.282957] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-131f51ef-2833-4453-914e-c87497d66ff6" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.283058] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('131f51ef-2833-4453-914e-c87497d66ff6',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.377531] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.377797] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.377904] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.378153] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.378249] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.378459] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.378560] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.378623] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.378778] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.378887] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.378966] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: abd587ac-a2db-4962-b166-638ba1590646 already deleted. [ 652.379075] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-abd587ac-a2db-4962-b166-638ba1590646" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.734360] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.734798] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.737486] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.737978] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.738310] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.740024] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Segment Port d348dd5f-ac2d-4111-8a23-07bf01dcd360 not found, creating... [ 652.740024] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.740024] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.740024] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.740024] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.740024] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.740024] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.740605] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.742907] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.742907] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.742907] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.742907] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Resource: SegmentPort with ID: d348dd5f-ac2d-4111-8a23-07bf01dcd360 is going to be created. [ 652.763947] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.763947] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.763947] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.763947] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.764209] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.764244] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "port-d348dd5f-ac2d-4111-8a23-07bf01dcd360" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.778736] env[69232]: INFO networking_nsxv3.common.synchronization [req-85b71b58-1f2d-429d-9b21-eb1cdc8c8a52 req-b70da092-3869-402e-9bf7-161af752bc19 service nova] Enqueued Resource ID: 9863f261-b349-427a-acad-78b2e3cc35a0 with Priority: HIGHEST for action security_group_rules [ 652.779059] env[69232]: INFO networking_nsxv3.common.synchronization [req-85b71b58-1f2d-429d-9b21-eb1cdc8c8a52 req-b70da092-3869-402e-9bf7-161af752bc19 service nova] Enqueued Resource ID: 9863f261-b349-427a-acad-78b2e3cc35a0 with Priority: HIGHEST for action security_group_members [ 652.779215] env[69232]: INFO networking_nsxv3.common.synchronization [req-85b71b58-1f2d-429d-9b21-eb1cdc8c8a52 req-b70da092-3869-402e-9bf7-161af752bc19 service nova] Enqueued Resource ID: 29f0a744-055e-4983-a39e-54c2cc9490e1 with Priority: HIGHEST for action port [ 652.779758] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9863f261-b349-427a-acad-78b2e3cc35a0 with Priority: HIGHEST for action security_group_rules [ 652.779901] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9863f261-b349-427a-acad-78b2e3cc35a0 with Priority: HIGHEST for action security_group_members [ 652.780115] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29f0a744-055e-4983-a39e-54c2cc9490e1 with Priority: HIGHEST for action port [ 652.780418] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9863f261-b349-427a-acad-78b2e3cc35a0 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.780543] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9863f261-b349-427a-acad-78b2e3cc35a0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.780608] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9863f261-b349-427a-acad-78b2e3cc35a0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.780957] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9863f261-b349-427a-acad-78b2e3cc35a0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.781057] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9863f261-b349-427a-acad-78b2e3cc35a0',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.782275] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-9863f261-b349-427a-acad-78b2e3cc35a0 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.782404] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9863f261-b349-427a-acad-78b2e3cc35a0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.782485] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9863f261-b349-427a-acad-78b2e3cc35a0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.782650] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9863f261-b349-427a-acad-78b2e3cc35a0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.782799] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.782916] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.782967] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.783128] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.783214] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.783306] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9863f261-b349-427a-acad-78b2e3cc35a0',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.784078] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-29f0a744-055e-4983-a39e-54c2cc9490e1 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.784195] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-29f0a744-055e-4983-a39e-54c2cc9490e1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.784290] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-29f0a744-055e-4983-a39e-54c2cc9490e1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.784388] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-29f0a744-055e-4983-a39e-54c2cc9490e1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.784459] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('29f0a744-055e-4983-a39e-54c2cc9490e1',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.787475] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-131f51ef-2833-4453-914e-c87497d66ff6 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.787595] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-131f51ef-2833-4453-914e-c87497d66ff6" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.787664] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-131f51ef-2833-4453-914e-c87497d66ff6" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.787821] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-131f51ef-2833-4453-914e-c87497d66ff6" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.787986] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.788268] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.788308] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.788451] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.788537] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.788626] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-131f51ef-2833-4453-914e-c87497d66ff6" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.788774] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-131f51ef-2833-4453-914e-c87497d66ff6 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.788896] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-131f51ef-2833-4453-914e-c87497d66ff6" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.788978] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-131f51ef-2833-4453-914e-c87497d66ff6" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.791069] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-131f51ef-2833-4453-914e-c87497d66ff6" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.791360] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.792599] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.792710] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.792948] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.793080] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.793229] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-131f51ef-2833-4453-914e-c87497d66ff6" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.793384] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('131f51ef-2833-4453-914e-c87497d66ff6',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.208681] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dcd9f79f-c997-4a2d-83a2-472c849b1794 in Status: SUCCESS [ 653.210660] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dcd9f79f-c997-4a2d-83a2-472c849b1794" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.210660] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dcd9f79f-c997-4a2d-83a2-472c849b1794" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.210660] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dcd9f79f-c997-4a2d-83a2-472c849b1794" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.210660] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dcd9f79f-c997-4a2d-83a2-472c849b1794',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.286816] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-9863f261-b349-427a-acad-78b2e3cc35a0 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.287331] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9863f261-b349-427a-acad-78b2e3cc35a0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.287331] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 29f0a744-055e-4983-a39e-54c2cc9490e1 with status ACTIVE [ 653.287445] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.287520] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.287637] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.287793] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.289061] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.289061] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.289061] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.289061] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.289061] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.289061] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.289061] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.289061] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.289061] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.289480] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.289480] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.289480] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 29f0a744-055e-4983-a39e-54c2cc9490e1 is going to be updated. [ 653.291563] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9863f261-b349-427a-acad-78b2e3cc35a0',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.297882] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 131f51ef-2833-4453-914e-c87497d66ff6: rpc.has_security_group_logging(os_id): False [ 653.320058] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.320058] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.320058] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.320058] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.320058] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.320058] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.320058] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.320058] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.320058] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.320771] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.320771] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.320771] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.320771] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.320771] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.320771] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.320978] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.321299] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.321299] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.321299] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.321469] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.321469] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 131f51ef-2833-4453-914e-c87497d66ff6 is going to be created. [ 653.326430] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.326430] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.326430] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.326430] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.326430] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.326430] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-29f0a744-055e-4983-a39e-54c2cc9490e1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.439558] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.439910] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.439910] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.440128] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.440209] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.455036] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 131f51ef-2833-4453-914e-c87497d66ff6 in Status: IN_PROGRESS for 2s [ 653.482520] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 36cbe3ea-321a-4c5f-b46b-f3297d4ccb49 in Status: SUCCESS [ 653.482809] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-36cbe3ea-321a-4c5f-b46b-f3297d4ccb49" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.535492] env[69232]: INFO networking_nsxv3.common.synchronization [req-7d22723e-f921-4a11-8cba-c6a36f201555 req-bb1b931a-1866-4b5e-8f3d-01c33294b202 service nova] Enqueued Resource ID: abd587ac-a2db-4962-b166-638ba1590646 with Priority: HIGHEST for action security_group_rules [ 653.535662] env[69232]: INFO networking_nsxv3.common.synchronization [req-7d22723e-f921-4a11-8cba-c6a36f201555 req-bb1b931a-1866-4b5e-8f3d-01c33294b202 service nova] Enqueued Resource ID: abd587ac-a2db-4962-b166-638ba1590646 with Priority: HIGHEST for action security_group_members [ 653.536952] env[69232]: INFO networking_nsxv3.common.synchronization [req-7d22723e-f921-4a11-8cba-c6a36f201555 req-bb1b931a-1866-4b5e-8f3d-01c33294b202 service nova] Enqueued Resource ID: d348dd5f-ac2d-4111-8a23-07bf01dcd360 with Priority: HIGHEST for action port [ 653.536952] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: abd587ac-a2db-4962-b166-638ba1590646 with Priority: HIGHEST for action security_group_rules [ 653.536952] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: abd587ac-a2db-4962-b166-638ba1590646 with Priority: HIGHEST for action security_group_members [ 653.536952] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d348dd5f-ac2d-4111-8a23-07bf01dcd360 with Priority: HIGHEST for action port [ 653.536952] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-abd587ac-a2db-4962-b166-638ba1590646 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.536952] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-abd587ac-a2db-4962-b166-638ba1590646" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.538012] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-abd587ac-a2db-4962-b166-638ba1590646" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.538012] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-abd587ac-a2db-4962-b166-638ba1590646" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.538012] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('abd587ac-a2db-4962-b166-638ba1590646',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.538323] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-abd587ac-a2db-4962-b166-638ba1590646 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.538447] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-abd587ac-a2db-4962-b166-638ba1590646" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.538516] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-abd587ac-a2db-4962-b166-638ba1590646" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.538704] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-abd587ac-a2db-4962-b166-638ba1590646" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.538866] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.538973] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.539057] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.539205] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.539286] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.539376] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('abd587ac-a2db-4962-b166-638ba1590646',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.540177] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-d348dd5f-ac2d-4111-8a23-07bf01dcd360 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.540298] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d348dd5f-ac2d-4111-8a23-07bf01dcd360" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.540338] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d348dd5f-ac2d-4111-8a23-07bf01dcd360" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.540485] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d348dd5f-ac2d-4111-8a23-07bf01dcd360" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.540558] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d348dd5f-ac2d-4111-8a23-07bf01dcd360',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.713252] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-dcd9f79f-c997-4a2d-83a2-472c849b1794 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.713252] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dcd9f79f-c997-4a2d-83a2-472c849b1794" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.713379] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dcd9f79f-c997-4a2d-83a2-472c849b1794" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.714093] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dcd9f79f-c997-4a2d-83a2-472c849b1794" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.714093] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.714093] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.714093] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.714287] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.714413] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.714465] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dcd9f79f-c997-4a2d-83a2-472c849b1794" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.714539] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dcd9f79f-c997-4a2d-83a2-472c849b1794',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.795677] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9863f261-b349-427a-acad-78b2e3cc35a0',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.047989] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('abd587ac-a2db-4962-b166-638ba1590646',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.049096] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-abd587ac-a2db-4962-b166-638ba1590646 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.049208] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-abd587ac-a2db-4962-b166-638ba1590646" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.049626] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d348dd5f-ac2d-4111-8a23-07bf01dcd360 with status ACTIVE [ 654.049853] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.049853] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.050148] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.050256] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.050356] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.050519] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.050591] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.050591] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.050801] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.050801] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.051135] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.051400] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.051400] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.051607] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.051607] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.055397] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d348dd5f-ac2d-4111-8a23-07bf01dcd360 is going to be updated. [ 654.082820] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.083199] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.083199] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.083310] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.083935] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.083935] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d348dd5f-ac2d-4111-8a23-07bf01dcd360" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.218855] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-dcd9f79f-c997-4a2d-83a2-472c849b1794 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.219115] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dcd9f79f-c997-4a2d-83a2-472c849b1794" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.219983] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dcd9f79f-c997-4a2d-83a2-472c849b1794" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.219983] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dcd9f79f-c997-4a2d-83a2-472c849b1794" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.219983] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.220220] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.220220] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.220296] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.220537] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.220537] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dcd9f79f-c997-4a2d-83a2-472c849b1794" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.220688] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-dcd9f79f-c997-4a2d-83a2-472c849b1794 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.220768] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dcd9f79f-c997-4a2d-83a2-472c849b1794" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.220824] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dcd9f79f-c997-4a2d-83a2-472c849b1794" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.221428] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dcd9f79f-c997-4a2d-83a2-472c849b1794" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.221428] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.221428] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.221428] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.221428] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.221746] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.221746] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dcd9f79f-c997-4a2d-83a2-472c849b1794" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.221746] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dcd9f79f-c997-4a2d-83a2-472c849b1794',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.298864] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.299317] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.299317] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.299431] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.299525] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.299629] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9863f261-b349-427a-acad-78b2e3cc35a0 is going to be created. [ 654.335241] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.335520] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.335615] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.335828] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.335999] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.354052] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9863f261-b349-427a-acad-78b2e3cc35a0 in Status: UNINITIALIZED for 2s [ 654.554936] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('abd587ac-a2db-4962-b166-638ba1590646',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.567193] env[69232]: INFO networking_nsxv3.common.synchronization [req-1153dcd1-a046-4932-ab56-dad8fbce160c req-101eb517-19dd-4a97-b807-89d400816232 tempest-ServerDiskConfigTestJSON-1562148127 tempest-ServerDiskConfigTestJSON-1562148127-project-member] Enqueued Resource ID: 5a45a455-673b-417d-b2f6-be9352c2077e with Priority: HIGHEST for action security_group_members [ 654.567193] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a45a455-673b-417d-b2f6-be9352c2077e with Priority: HIGHEST for action security_group_members [ 654.567193] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a45a455-673b-417d-b2f6-be9352c2077e taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.568681] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a45a455-673b-417d-b2f6-be9352c2077e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.568681] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a45a455-673b-417d-b2f6-be9352c2077e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.568681] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a45a455-673b-417d-b2f6-be9352c2077e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.568681] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.568681] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.568681] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.570186] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.570186] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.570186] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5a45a455-673b-417d-b2f6-be9352c2077e',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.725178] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dcd9f79f-c997-4a2d-83a2-472c849b1794: rpc.has_security_group_logging(os_id): False [ 654.748023] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.748023] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.748023] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.748023] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.748023] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.748431] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.748431] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.748431] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.748626] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.748626] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.748773] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.748921] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.749024] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.749179] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.749248] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.750026] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.750194] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.750194] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.751031] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.751031] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.751031] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dcd9f79f-c997-4a2d-83a2-472c849b1794 is going to be updated. [ 654.829688] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.829688] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.829688] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.829688] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.829688] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.844563] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dcd9f79f-c997-4a2d-83a2-472c849b1794 in Status: IN_PROGRESS for 2s [ 655.061358] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.062058] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.062520] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.062839] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.065545] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.065677] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: abd587ac-a2db-4962-b166-638ba1590646 is going to be created. [ 655.074682] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.074834] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.074910] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.075157] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.075279] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.075513] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.075642] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.075718] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.075843] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.075951] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.076029] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5a45a455-673b-417d-b2f6-be9352c2077e already deleted. [ 655.076103] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a45a455-673b-417d-b2f6-be9352c2077e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.099620] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.100689] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.100689] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.100689] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.100689] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.112984] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: abd587ac-a2db-4962-b166-638ba1590646 in Status: UNINITIALIZED for 2s [ 655.217620] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock network-846 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.217863] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "network-846" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.217993] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "network-846" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.218387] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "network-846" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.218663] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.218848] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.218989] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.220825] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.220825] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.221983] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 655.222163] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] NeedRegenerationException {{(pid=69232) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 655.222284] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] no value, waiting for create lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 655.222396] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] value creation lock acquired {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 655.222513] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 655.222679] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Calling creation function for not-yet-present value {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 655.222821] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 655.257403] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 655.257589] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Cache value generated in 0.035 seconds for key(s): 'zone-id' {{(pid=69232) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 655.257589] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Released creation lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 655.257908] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "network-846" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.258302] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock port-ce675fff-664f-4035-a232-c8d8b66b41b9 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.258605] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "port-ce675fff-664f-4035-a232-c8d8b66b41b9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.258690] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "port-ce675fff-664f-4035-a232-c8d8b66b41b9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.259291] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "port-ce675fff-664f-4035-a232-c8d8b66b41b9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.259382] env[69232]: DEBUG networking_nsxv3.api.rpc [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ce675fff-664f-4035-a232-c8d8b66b41b9',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.471922] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 131f51ef-2833-4453-914e-c87497d66ff6 in Status: SUCCESS [ 655.472528] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-131f51ef-2833-4453-914e-c87497d66ff6" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.767906] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.767906] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.767906] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.767906] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.767906] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.767906] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Segment Port ce675fff-664f-4035-a232-c8d8b66b41b9 not found, creating... [ 655.767906] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.767906] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.767906] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.768974] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.769677] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.772981] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.772981] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.772981] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.772981] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.772981] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.772981] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Resource: SegmentPort with ID: ce675fff-664f-4035-a232-c8d8b66b41b9 is going to be created. [ 655.926154] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.926425] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.926569] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.926861] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.927211] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.927407] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "port-ce675fff-664f-4035-a232-c8d8b66b41b9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.145545] env[69232]: INFO networking_nsxv3.common.synchronization [req-1006d490-5697-49cf-90f0-899fc71c6bb0 req-20ed8361-61a8-463d-899e-0a88ed2a7dac tempest-SecurityGroupRulesTestJSON-29443989 tempest-SecurityGroupRulesTestJSON-29443989-project-member] Enqueued Resource ID: 674ae9fa-0f35-4003-93ed-641de5719ade with Priority: HIGHEST for action security_group_rules [ 656.146275] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 674ae9fa-0f35-4003-93ed-641de5719ade with Priority: HIGHEST for action security_group_rules [ 656.146551] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-674ae9fa-0f35-4003-93ed-641de5719ade taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.146707] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-674ae9fa-0f35-4003-93ed-641de5719ade" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.146925] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-674ae9fa-0f35-4003-93ed-641de5719ade" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.147110] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-674ae9fa-0f35-4003-93ed-641de5719ade" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.147331] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('674ae9fa-0f35-4003-93ed-641de5719ade',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.370803] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9863f261-b349-427a-acad-78b2e3cc35a0 in Status: SUCCESS [ 656.371541] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9863f261-b349-427a-acad-78b2e3cc35a0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.373039] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9863f261-b349-427a-acad-78b2e3cc35a0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.373039] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9863f261-b349-427a-acad-78b2e3cc35a0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.373039] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.373039] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.373039] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.373039] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.373937] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.375130] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9863f261-b349-427a-acad-78b2e3cc35a0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.375130] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9863f261-b349-427a-acad-78b2e3cc35a0',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.672406] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.672734] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.672734] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.673251] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.673423] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.673704] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 674ae9fa-0f35-4003-93ed-641de5719ade already deleted. [ 656.673704] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-674ae9fa-0f35-4003-93ed-641de5719ade" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.731248] env[69232]: INFO networking_nsxv3.common.synchronization [req-1153dcd1-a046-4932-ab56-dad8fbce160c req-111bd55f-81f9-426d-88c4-9ca8423f54ac service nova] Enqueued Resource ID: 5a45a455-673b-417d-b2f6-be9352c2077e with Priority: HIGHEST for action security_group_rules [ 656.731248] env[69232]: INFO networking_nsxv3.common.synchronization [req-1153dcd1-a046-4932-ab56-dad8fbce160c req-111bd55f-81f9-426d-88c4-9ca8423f54ac service nova] Enqueued Resource ID: 5a45a455-673b-417d-b2f6-be9352c2077e with Priority: HIGHEST for action security_group_members [ 656.731248] env[69232]: INFO networking_nsxv3.common.synchronization [req-1153dcd1-a046-4932-ab56-dad8fbce160c req-111bd55f-81f9-426d-88c4-9ca8423f54ac service nova] Enqueued Resource ID: ce675fff-664f-4035-a232-c8d8b66b41b9 with Priority: HIGHEST for action port [ 656.731248] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a45a455-673b-417d-b2f6-be9352c2077e with Priority: HIGHEST for action security_group_rules [ 656.731248] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a45a455-673b-417d-b2f6-be9352c2077e with Priority: HIGHEST for action security_group_members [ 656.731248] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce675fff-664f-4035-a232-c8d8b66b41b9 with Priority: HIGHEST for action port [ 656.734573] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5a45a455-673b-417d-b2f6-be9352c2077e taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.734906] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5a45a455-673b-417d-b2f6-be9352c2077e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.735083] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5a45a455-673b-417d-b2f6-be9352c2077e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.735507] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5a45a455-673b-417d-b2f6-be9352c2077e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.735708] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5a45a455-673b-417d-b2f6-be9352c2077e',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.741165] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a45a455-673b-417d-b2f6-be9352c2077e taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.741165] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a45a455-673b-417d-b2f6-be9352c2077e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.741165] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a45a455-673b-417d-b2f6-be9352c2077e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.741903] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a45a455-673b-417d-b2f6-be9352c2077e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.742266] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.742504] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.742719] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.743121] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.743426] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.743583] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5a45a455-673b-417d-b2f6-be9352c2077e',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.748032] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-ce675fff-664f-4035-a232-c8d8b66b41b9 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.748032] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ce675fff-664f-4035-a232-c8d8b66b41b9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.748032] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ce675fff-664f-4035-a232-c8d8b66b41b9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.748032] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ce675fff-664f-4035-a232-c8d8b66b41b9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.748032] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ce675fff-664f-4035-a232-c8d8b66b41b9',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.861804] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dcd9f79f-c997-4a2d-83a2-472c849b1794 in Status: SUCCESS [ 656.861804] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dcd9f79f-c997-4a2d-83a2-472c849b1794" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.877163] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-9863f261-b349-427a-acad-78b2e3cc35a0 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.877402] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9863f261-b349-427a-acad-78b2e3cc35a0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.877573] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9863f261-b349-427a-acad-78b2e3cc35a0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.877776] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9863f261-b349-427a-acad-78b2e3cc35a0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.878012] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.878140] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.878202] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.878386] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.878468] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.878549] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9863f261-b349-427a-acad-78b2e3cc35a0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.878696] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-9863f261-b349-427a-acad-78b2e3cc35a0 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.879273] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9863f261-b349-427a-acad-78b2e3cc35a0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.879273] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9863f261-b349-427a-acad-78b2e3cc35a0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.884087] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9863f261-b349-427a-acad-78b2e3cc35a0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.884414] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.884598] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.884770] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.887030] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.887030] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.887030] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9863f261-b349-427a-acad-78b2e3cc35a0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.887030] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9863f261-b349-427a-acad-78b2e3cc35a0',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.124396] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: abd587ac-a2db-4962-b166-638ba1590646 in Status: SUCCESS [ 657.124396] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-abd587ac-a2db-4962-b166-638ba1590646" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.124653] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-abd587ac-a2db-4962-b166-638ba1590646" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.124791] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-abd587ac-a2db-4962-b166-638ba1590646" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.124982] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.125151] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.125226] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.125414] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.125510] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.125610] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-abd587ac-a2db-4962-b166-638ba1590646" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.125703] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('abd587ac-a2db-4962-b166-638ba1590646',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.241144] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a45a455-673b-417d-b2f6-be9352c2077e taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.241144] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a45a455-673b-417d-b2f6-be9352c2077e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.248119] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5a45a455-673b-417d-b2f6-be9352c2077e',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.252512] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ce675fff-664f-4035-a232-c8d8b66b41b9 with status ACTIVE [ 657.252512] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.252512] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.252512] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.252789] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.252996] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.253508] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.254286] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.254602] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.254979] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.256375] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.256709] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.256937] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.257205] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.260315] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.260445] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.260650] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ce675fff-664f-4035-a232-c8d8b66b41b9 is going to be updated. [ 657.285425] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.285614] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.285660] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.285904] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.286082] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.286293] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ce675fff-664f-4035-a232-c8d8b66b41b9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.390650] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9863f261-b349-427a-acad-78b2e3cc35a0: rpc.has_security_group_logging(os_id): False [ 657.414489] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.414489] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.414656] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.414900] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.415048] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.415339] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.415772] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.415772] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.415772] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.415896] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.416206] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.416291] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.416379] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.416938] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.416938] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.416938] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.416938] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.417150] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.417581] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.417581] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.417581] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9863f261-b349-427a-acad-78b2e3cc35a0 is going to be created. [ 657.442419] env[69232]: INFO networking_nsxv3.common.synchronization [req-413a0149-88bd-4b03-97dc-e1fe42bc21b1 req-a8400529-0c1a-4bde-a1bd-197919757057 tempest-ServerRescueNegativeTestJSON-737130981 tempest-ServerRescueNegativeTestJSON-737130981-project-member] Enqueued Resource ID: f75b07e5-04f2-4dc3-80ad-ba8105cb4c82 with Priority: HIGHEST for action security_group_members [ 657.442720] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f75b07e5-04f2-4dc3-80ad-ba8105cb4c82 with Priority: HIGHEST for action security_group_members [ 657.443411] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-f75b07e5-04f2-4dc3-80ad-ba8105cb4c82 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.443803] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f75b07e5-04f2-4dc3-80ad-ba8105cb4c82" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.443995] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f75b07e5-04f2-4dc3-80ad-ba8105cb4c82" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.444798] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f75b07e5-04f2-4dc3-80ad-ba8105cb4c82" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.445162] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.445417] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.445591] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.446531] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.446740] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.449345] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f75b07e5-04f2-4dc3-80ad-ba8105cb4c82',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.508767] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.509052] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.509052] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.509379] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.509478] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.525191] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9863f261-b349-427a-acad-78b2e3cc35a0 in Status: IN_PROGRESS for 2s [ 657.628689] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-abd587ac-a2db-4962-b166-638ba1590646 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.629253] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-abd587ac-a2db-4962-b166-638ba1590646" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.629253] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-abd587ac-a2db-4962-b166-638ba1590646" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.629253] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-abd587ac-a2db-4962-b166-638ba1590646" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.629430] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.629430] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.629548] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.629597] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.630469] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.630469] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-abd587ac-a2db-4962-b166-638ba1590646" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.630469] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-abd587ac-a2db-4962-b166-638ba1590646 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.630469] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-abd587ac-a2db-4962-b166-638ba1590646" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.630469] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-abd587ac-a2db-4962-b166-638ba1590646" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.630469] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-abd587ac-a2db-4962-b166-638ba1590646" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.630469] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.630469] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.630949] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.630949] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.630949] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.630949] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-abd587ac-a2db-4962-b166-638ba1590646" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.630949] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('abd587ac-a2db-4962-b166-638ba1590646',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.762996] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5a45a455-673b-417d-b2f6-be9352c2077e',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.951740] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.951938] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.951992] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.952358] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.952574] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.952804] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.952963] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.953084] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.953295] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.953434] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.953565] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f75b07e5-04f2-4dc3-80ad-ba8105cb4c82 already deleted. [ 657.953666] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f75b07e5-04f2-4dc3-80ad-ba8105cb4c82" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.133434] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for abd587ac-a2db-4962-b166-638ba1590646: rpc.has_security_group_logging(os_id): False [ 658.153215] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.153573] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.153663] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.153828] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.153923] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.154175] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.154294] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.154392] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.154593] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.154673] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.155126] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.155126] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.155126] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.155381] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.155502] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.155723] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.155823] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.155886] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.156046] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.156163] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.156285] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: abd587ac-a2db-4962-b166-638ba1590646 is going to be created. [ 658.210566] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock network-887 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.210998] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "network-887" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.210998] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "network-887" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.211253] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "network-887" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.211793] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.211793] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.211952] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.212515] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.213358] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.213469] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 658.213678] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] NeedRegenerationException {{(pid=69232) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 658.213894] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] no value, waiting for create lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 658.213894] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] value creation lock acquired {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 658.213970] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 658.214546] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Calling creation function for not-yet-present value {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 658.214832] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 658.236141] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.236141] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.236271] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.236568] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.236816] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.243420] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 658.243420] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=69232) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 658.243606] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Released creation lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 658.244127] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "network-887" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.244127] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock port-9ef0a933-060a-448b-a3f6-ee813dde2802 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.246684] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "port-9ef0a933-060a-448b-a3f6-ee813dde2802" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.246854] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "port-9ef0a933-060a-448b-a3f6-ee813dde2802" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.247310] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "port-9ef0a933-060a-448b-a3f6-ee813dde2802" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.247511] env[69232]: DEBUG networking_nsxv3.api.rpc [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9ef0a933-060a-448b-a3f6-ee813dde2802',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.262742] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: abd587ac-a2db-4962-b166-638ba1590646 in Status: IN_PROGRESS for 2s [ 658.267615] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.267615] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.267615] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.268088] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.268088] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.268088] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5a45a455-673b-417d-b2f6-be9352c2077e is going to be created. [ 658.312056] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.312056] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.312056] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.312056] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.312056] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.323912] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a45a455-673b-417d-b2f6-be9352c2077e in Status: UNINITIALIZED for 2s [ 658.751792] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.752117] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.752297] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.753142] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.753373] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.753596] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Segment Port 9ef0a933-060a-448b-a3f6-ee813dde2802 not found, creating... [ 658.753988] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.754241] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.754410] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.754836] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.754925] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.755351] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.755574] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.755740] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.756054] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.756408] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.756455] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Resource: SegmentPort with ID: 9ef0a933-060a-448b-a3f6-ee813dde2802 is going to be created. [ 658.761531] env[69232]: INFO networking_nsxv3.common.synchronization [None req-97cf870b-c1bf-448e-af70-c295033fa265 None None] Enqueued Resource ID: 0916db6f-876e-4302-84a9-1357ff787d2e with Priority: HIGHEST for action port [ 658.762313] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0916db6f-876e-4302-84a9-1357ff787d2e with Priority: HIGHEST for action port [ 658.766399] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-0916db6f-876e-4302-84a9-1357ff787d2e taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.766740] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0916db6f-876e-4302-84a9-1357ff787d2e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.766740] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0916db6f-876e-4302-84a9-1357ff787d2e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.766993] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0916db6f-876e-4302-84a9-1357ff787d2e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.767170] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0916db6f-876e-4302-84a9-1357ff787d2e',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.784082] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.784295] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.784419] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.784746] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.785104] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.785404] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "port-9ef0a933-060a-448b-a3f6-ee813dde2802" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.271926] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0916db6f-876e-4302-84a9-1357ff787d2e [ 659.271926] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.271926] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.271926] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.272363] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.272363] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.272363] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0916db6f-876e-4302-84a9-1357ff787d2e already deleted. [ 659.272603] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0916db6f-876e-4302-84a9-1357ff787d2e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.538850] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9863f261-b349-427a-acad-78b2e3cc35a0 in Status: SUCCESS [ 659.539360] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9863f261-b349-427a-acad-78b2e3cc35a0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.227885] env[69232]: INFO networking_nsxv3.common.synchronization [req-413a0149-88bd-4b03-97dc-e1fe42bc21b1 req-0d6f88a0-2cdf-4493-9085-91d8477ad0b0 service nova] Enqueued Resource ID: f75b07e5-04f2-4dc3-80ad-ba8105cb4c82 with Priority: HIGHEST for action security_group_rules [ 660.227885] env[69232]: INFO networking_nsxv3.common.synchronization [req-413a0149-88bd-4b03-97dc-e1fe42bc21b1 req-0d6f88a0-2cdf-4493-9085-91d8477ad0b0 service nova] Enqueued Resource ID: f75b07e5-04f2-4dc3-80ad-ba8105cb4c82 with Priority: HIGHEST for action security_group_members [ 660.228248] env[69232]: INFO networking_nsxv3.common.synchronization [req-413a0149-88bd-4b03-97dc-e1fe42bc21b1 req-0d6f88a0-2cdf-4493-9085-91d8477ad0b0 service nova] Enqueued Resource ID: 9ef0a933-060a-448b-a3f6-ee813dde2802 with Priority: HIGHEST for action port [ 660.228248] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f75b07e5-04f2-4dc3-80ad-ba8105cb4c82 with Priority: HIGHEST for action security_group_rules [ 660.228326] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f75b07e5-04f2-4dc3-80ad-ba8105cb4c82 with Priority: HIGHEST for action security_group_members [ 660.228860] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ef0a933-060a-448b-a3f6-ee813dde2802 with Priority: HIGHEST for action port [ 660.228998] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f75b07e5-04f2-4dc3-80ad-ba8105cb4c82 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.229115] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f75b07e5-04f2-4dc3-80ad-ba8105cb4c82" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.229179] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f75b07e5-04f2-4dc3-80ad-ba8105cb4c82" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.229431] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f75b07e5-04f2-4dc3-80ad-ba8105cb4c82" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.229508] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f75b07e5-04f2-4dc3-80ad-ba8105cb4c82',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.231101] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-f75b07e5-04f2-4dc3-80ad-ba8105cb4c82 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.231101] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f75b07e5-04f2-4dc3-80ad-ba8105cb4c82" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.231101] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f75b07e5-04f2-4dc3-80ad-ba8105cb4c82" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.231101] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f75b07e5-04f2-4dc3-80ad-ba8105cb4c82" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.231101] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.231101] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.231101] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.231752] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.231752] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.231752] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f75b07e5-04f2-4dc3-80ad-ba8105cb4c82',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.232193] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-9ef0a933-060a-448b-a3f6-ee813dde2802 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.232193] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9ef0a933-060a-448b-a3f6-ee813dde2802" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.232358] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9ef0a933-060a-448b-a3f6-ee813dde2802" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.232453] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9ef0a933-060a-448b-a3f6-ee813dde2802" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.232489] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9ef0a933-060a-448b-a3f6-ee813dde2802',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.278030] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: abd587ac-a2db-4962-b166-638ba1590646 in Status: SUCCESS [ 660.278030] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-abd587ac-a2db-4962-b166-638ba1590646" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.321545] env[69232]: INFO networking_nsxv3.common.synchronization [req-10a1ce7d-1d60-462b-a092-da70bea7a673 req-e91dc305-7960-407d-9d26-f9dc6fd7d1e7 tempest-FloatingIPsAssociationTestJSON-136976334 tempest-FloatingIPsAssociationTestJSON-136976334-project-member] Enqueued Resource ID: 5435d71f-3832-4f11-be57-bef3011dd7b7 with Priority: HIGHEST for action security_group_members [ 660.321712] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5435d71f-3832-4f11-be57-bef3011dd7b7 with Priority: HIGHEST for action security_group_members [ 660.322370] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-5435d71f-3832-4f11-be57-bef3011dd7b7 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.322698] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5435d71f-3832-4f11-be57-bef3011dd7b7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.322698] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5435d71f-3832-4f11-be57-bef3011dd7b7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.322809] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5435d71f-3832-4f11-be57-bef3011dd7b7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.322939] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.323060] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.323135] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.323287] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.323387] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.323482] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5435d71f-3832-4f11-be57-bef3011dd7b7',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.335133] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a45a455-673b-417d-b2f6-be9352c2077e in Status: SUCCESS [ 660.335456] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a45a455-673b-417d-b2f6-be9352c2077e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.335991] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a45a455-673b-417d-b2f6-be9352c2077e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.336596] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a45a455-673b-417d-b2f6-be9352c2077e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.336596] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.336596] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.336777] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.337083] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.337083] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.337234] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a45a455-673b-417d-b2f6-be9352c2077e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.337407] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5a45a455-673b-417d-b2f6-be9352c2077e',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.733965] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f75b07e5-04f2-4dc3-80ad-ba8105cb4c82',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.735110] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-f75b07e5-04f2-4dc3-80ad-ba8105cb4c82 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.735271] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f75b07e5-04f2-4dc3-80ad-ba8105cb4c82" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.735769] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9ef0a933-060a-448b-a3f6-ee813dde2802 with status ACTIVE [ 660.735978] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.740171] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.740171] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.740171] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.740171] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.740171] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.740171] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.740171] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.740171] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.740171] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.740171] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.740171] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.740171] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.740171] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.740171] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.740171] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9ef0a933-060a-448b-a3f6-ee813dde2802 is going to be updated. [ 660.765139] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.765303] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.765370] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.765625] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.765769] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.765950] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9ef0a933-060a-448b-a3f6-ee813dde2802" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.826557] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5435d71f-3832-4f11-be57-bef3011dd7b7',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.839890] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a45a455-673b-417d-b2f6-be9352c2077e taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.840137] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a45a455-673b-417d-b2f6-be9352c2077e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.840137] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a45a455-673b-417d-b2f6-be9352c2077e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.840479] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a45a455-673b-417d-b2f6-be9352c2077e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.840589] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.840589] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.840730] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.841125] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.841231] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.842148] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a45a455-673b-417d-b2f6-be9352c2077e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.842332] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a45a455-673b-417d-b2f6-be9352c2077e taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.842439] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a45a455-673b-417d-b2f6-be9352c2077e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.842498] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a45a455-673b-417d-b2f6-be9352c2077e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.842660] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a45a455-673b-417d-b2f6-be9352c2077e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.842802] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.842897] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.842952] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.844468] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.844691] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.844691] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a45a455-673b-417d-b2f6-be9352c2077e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.844806] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5a45a455-673b-417d-b2f6-be9352c2077e',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.034105] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock network-105 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.034395] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "network-105" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.034535] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "network-105" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.034808] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "network-105" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.035080] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.035240] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.035355] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.035569] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.035747] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.035965] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 661.036093] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] NeedRegenerationException {{(pid=69232) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 661.036205] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] no value, waiting for create lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 661.036322] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] value creation lock acquired {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 661.036757] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 661.036955] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Calling creation function for not-yet-present value {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 661.037119] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 661.058976] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 661.059211] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69232) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 661.059339] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Released creation lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 661.059520] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "network-105" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.059859] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock port-0e2f172d-8f60-4c74-a7e0-f7cf60f76869 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.060046] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "port-0e2f172d-8f60-4c74-a7e0-f7cf60f76869" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.060126] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "port-0e2f172d-8f60-4c74-a7e0-f7cf60f76869" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.060453] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "port-0e2f172d-8f60-4c74-a7e0-f7cf60f76869" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.060596] env[69232]: DEBUG networking_nsxv3.api.rpc [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0e2f172d-8f60-4c74-a7e0-f7cf60f76869',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.236440] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f75b07e5-04f2-4dc3-80ad-ba8105cb4c82',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.330495] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5435d71f-3832-4f11-be57-bef3011dd7b7',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.347780] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5a45a455-673b-417d-b2f6-be9352c2077e: rpc.has_security_group_logging(os_id): False [ 661.374662] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.375670] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.375670] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.375670] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.375670] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.375670] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.375670] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.375670] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.376023] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.376023] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.376117] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.376229] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.376270] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.376450] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.376525] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.376728] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.376888] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.376888] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.377363] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.377679] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.377781] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5a45a455-673b-417d-b2f6-be9352c2077e is going to be created. [ 661.478905] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.479223] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.479327] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.479821] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.480133] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.505726] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5a45a455-673b-417d-b2f6-be9352c2077e in Status: IN_PROGRESS for 2s [ 661.562691] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.563202] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.563541] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.564343] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.564505] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.564815] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Segment Port 0e2f172d-8f60-4c74-a7e0-f7cf60f76869 not found, creating... [ 661.564971] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.565149] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.565592] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.565592] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.565795] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.565942] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.568409] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.568575] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.569026] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.570814] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.574027] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Resource: SegmentPort with ID: 0e2f172d-8f60-4c74-a7e0-f7cf60f76869 is going to be created. [ 661.597759] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.598233] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.598309] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.598626] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.598980] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.600050] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "port-0e2f172d-8f60-4c74-a7e0-f7cf60f76869" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.740758] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.740992] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.741058] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.741656] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.741656] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.741656] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f75b07e5-04f2-4dc3-80ad-ba8105cb4c82 is going to be created. [ 661.777260] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.777411] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.777503] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.777728] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.777886] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.791167] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f75b07e5-04f2-4dc3-80ad-ba8105cb4c82 in Status: UNINITIALIZED for 2s [ 661.796930] env[69232]: INFO networking_nsxv3.common.synchronization [None req-d7ee5e58-a3bd-4962-8eb3-81b030edccdb None None] Enqueued Resource ID: e8e6d25d-3733-4ca4-a746-750e4d230257 with Priority: HIGHEST for action port [ 661.797214] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e8e6d25d-3733-4ca4-a746-750e4d230257 with Priority: HIGHEST for action port [ 661.797864] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-e8e6d25d-3733-4ca4-a746-750e4d230257 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.798030] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e8e6d25d-3733-4ca4-a746-750e4d230257" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.798101] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e8e6d25d-3733-4ca4-a746-750e4d230257" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.798370] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e8e6d25d-3733-4ca4-a746-750e4d230257" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.798457] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e8e6d25d-3733-4ca4-a746-750e4d230257',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.834281] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.834281] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.834421] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.834583] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.834682] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.834775] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5435d71f-3832-4f11-be57-bef3011dd7b7 is going to be updated. [ 661.878211] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.878362] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.878436] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.878992] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.878992] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.890788] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5435d71f-3832-4f11-be57-bef3011dd7b7 in Status: IN_PROGRESS for 2s [ 662.300564] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e8e6d25d-3733-4ca4-a746-750e4d230257 [ 662.302891] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.302891] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.302891] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.302891] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.302891] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.302891] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e8e6d25d-3733-4ca4-a746-750e4d230257 already deleted. [ 662.302891] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e8e6d25d-3733-4ca4-a746-750e4d230257" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.706411] env[69232]: INFO networking_nsxv3.common.synchronization [req-10a1ce7d-1d60-462b-a092-da70bea7a673 req-c61d104d-72eb-4e34-ad9c-3d5950bd63ba service nova] Enqueued Resource ID: 5435d71f-3832-4f11-be57-bef3011dd7b7 with Priority: HIGHEST for action security_group_rules [ 662.706411] env[69232]: INFO networking_nsxv3.common.synchronization [req-10a1ce7d-1d60-462b-a092-da70bea7a673 req-c61d104d-72eb-4e34-ad9c-3d5950bd63ba service nova] Enqueued Resource ID: 5435d71f-3832-4f11-be57-bef3011dd7b7 with Priority: HIGHEST for action security_group_members [ 662.706411] env[69232]: INFO networking_nsxv3.common.synchronization [req-10a1ce7d-1d60-462b-a092-da70bea7a673 req-c61d104d-72eb-4e34-ad9c-3d5950bd63ba service nova] Enqueued Resource ID: 0e2f172d-8f60-4c74-a7e0-f7cf60f76869 with Priority: HIGHEST for action port [ 662.706411] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5435d71f-3832-4f11-be57-bef3011dd7b7 with Priority: HIGHEST for action security_group_rules [ 662.706411] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5435d71f-3832-4f11-be57-bef3011dd7b7 with Priority: HIGHEST for action security_group_members [ 662.706411] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e2f172d-8f60-4c74-a7e0-f7cf60f76869 with Priority: HIGHEST for action port [ 662.707540] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5435d71f-3832-4f11-be57-bef3011dd7b7 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.707748] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5435d71f-3832-4f11-be57-bef3011dd7b7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.707868] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5435d71f-3832-4f11-be57-bef3011dd7b7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.709377] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5435d71f-3832-4f11-be57-bef3011dd7b7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.709377] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5435d71f-3832-4f11-be57-bef3011dd7b7',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.709792] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-5435d71f-3832-4f11-be57-bef3011dd7b7 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.709884] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5435d71f-3832-4f11-be57-bef3011dd7b7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.710231] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-0e2f172d-8f60-4c74-a7e0-f7cf60f76869 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.710401] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0e2f172d-8f60-4c74-a7e0-f7cf60f76869" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.710507] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0e2f172d-8f60-4c74-a7e0-f7cf60f76869" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.710799] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0e2f172d-8f60-4c74-a7e0-f7cf60f76869" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.710932] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0e2f172d-8f60-4c74-a7e0-f7cf60f76869',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.773268] env[69232]: INFO networking_nsxv3.common.synchronization [req-df0f9965-0df6-4b41-be68-97f8fda5658c req-8b3544ef-4c9a-4f8e-9dcc-0453f4f5fb17 tempest-SecurityGroupRulesTestJSON-29443989 tempest-SecurityGroupRulesTestJSON-29443989-project-member] Enqueued Resource ID: fefdd383-3f1a-4540-a3cf-1f8b9a6a0eb1 with Priority: HIGHEST for action security_group_rules [ 662.773726] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fefdd383-3f1a-4540-a3cf-1f8b9a6a0eb1 with Priority: HIGHEST for action security_group_rules [ 662.774019] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fefdd383-3f1a-4540-a3cf-1f8b9a6a0eb1 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.774198] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fefdd383-3f1a-4540-a3cf-1f8b9a6a0eb1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.774295] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fefdd383-3f1a-4540-a3cf-1f8b9a6a0eb1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.774548] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fefdd383-3f1a-4540-a3cf-1f8b9a6a0eb1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.774636] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fefdd383-3f1a-4540-a3cf-1f8b9a6a0eb1',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.215629] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-5435d71f-3832-4f11-be57-bef3011dd7b7 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.215833] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5435d71f-3832-4f11-be57-bef3011dd7b7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.216166] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0e2f172d-8f60-4c74-a7e0-f7cf60f76869 with status ACTIVE [ 663.216400] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.216567] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.216667] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.217035] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.217157] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.217350] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.217484] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.217543] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.217681] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.217754] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.217935] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.218123] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.218123] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.218246] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.218455] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.218455] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0e2f172d-8f60-4c74-a7e0-f7cf60f76869 is going to be updated. [ 663.247557] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.247557] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.247557] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.247557] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.247557] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.247557] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0e2f172d-8f60-4c74-a7e0-f7cf60f76869" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.301136] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.301594] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.301594] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.301594] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.301819] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.301819] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fefdd383-3f1a-4540-a3cf-1f8b9a6a0eb1 already deleted. [ 663.301886] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fefdd383-3f1a-4540-a3cf-1f8b9a6a0eb1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.520209] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5a45a455-673b-417d-b2f6-be9352c2077e in Status: SUCCESS [ 663.520468] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5a45a455-673b-417d-b2f6-be9352c2077e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.805071] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f75b07e5-04f2-4dc3-80ad-ba8105cb4c82 in Status: SUCCESS [ 663.805352] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f75b07e5-04f2-4dc3-80ad-ba8105cb4c82" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.805949] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f75b07e5-04f2-4dc3-80ad-ba8105cb4c82" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.806197] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f75b07e5-04f2-4dc3-80ad-ba8105cb4c82" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.806667] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.806667] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.806667] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.806962] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.806962] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.806962] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f75b07e5-04f2-4dc3-80ad-ba8105cb4c82" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.807159] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f75b07e5-04f2-4dc3-80ad-ba8105cb4c82',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.903734] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5435d71f-3832-4f11-be57-bef3011dd7b7 in Status: SUCCESS [ 663.903963] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5435d71f-3832-4f11-be57-bef3011dd7b7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.904162] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5435d71f-3832-4f11-be57-bef3011dd7b7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.904462] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5435d71f-3832-4f11-be57-bef3011dd7b7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.904642] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.904763] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.904830] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.905024] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.905274] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.905274] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5435d71f-3832-4f11-be57-bef3011dd7b7',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.176389] env[69232]: INFO networking_nsxv3.common.synchronization [req-5d3e6747-95f5-4c6d-a286-954c1622d33f req-deddc78b-d965-4c95-b789-1354788fb796 tempest-SecurityGroupRulesTestJSON-29443989 tempest-SecurityGroupRulesTestJSON-29443989-project-member] Enqueued Resource ID: fefdd383-3f1a-4540-a3cf-1f8b9a6a0eb1 with Priority: HIGHEST for action security_group_rules [ 664.176389] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fefdd383-3f1a-4540-a3cf-1f8b9a6a0eb1 with Priority: HIGHEST for action security_group_rules [ 664.177345] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fefdd383-3f1a-4540-a3cf-1f8b9a6a0eb1 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.177689] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fefdd383-3f1a-4540-a3cf-1f8b9a6a0eb1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.177893] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fefdd383-3f1a-4540-a3cf-1f8b9a6a0eb1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.178407] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fefdd383-3f1a-4540-a3cf-1f8b9a6a0eb1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.178626] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fefdd383-3f1a-4540-a3cf-1f8b9a6a0eb1',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.313268] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-f75b07e5-04f2-4dc3-80ad-ba8105cb4c82 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.313668] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f75b07e5-04f2-4dc3-80ad-ba8105cb4c82" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.313668] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f75b07e5-04f2-4dc3-80ad-ba8105cb4c82" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.313747] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f75b07e5-04f2-4dc3-80ad-ba8105cb4c82" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.314134] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.314134] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.314288] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.314399] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.314492] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.314585] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f75b07e5-04f2-4dc3-80ad-ba8105cb4c82" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.314739] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-f75b07e5-04f2-4dc3-80ad-ba8105cb4c82 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.314827] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f75b07e5-04f2-4dc3-80ad-ba8105cb4c82" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.314888] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f75b07e5-04f2-4dc3-80ad-ba8105cb4c82" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.315035] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f75b07e5-04f2-4dc3-80ad-ba8105cb4c82" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.315172] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.315266] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.315324] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.315452] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.315525] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.315606] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f75b07e5-04f2-4dc3-80ad-ba8105cb4c82" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.315694] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f75b07e5-04f2-4dc3-80ad-ba8105cb4c82',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.406950] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5435d71f-3832-4f11-be57-bef3011dd7b7',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.707930] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.707930] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.707930] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.707930] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.707930] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.707930] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fefdd383-3f1a-4540-a3cf-1f8b9a6a0eb1 already deleted. [ 664.707930] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fefdd383-3f1a-4540-a3cf-1f8b9a6a0eb1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.818831] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f75b07e5-04f2-4dc3-80ad-ba8105cb4c82: rpc.has_security_group_logging(os_id): False [ 664.845559] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.845559] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.845559] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.845559] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.845559] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.845896] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.846929] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.846929] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.847066] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.847100] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.847331] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.847465] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.847535] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.847766] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.847945] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.848203] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.848326] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.848396] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.848628] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.848728] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.848834] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f75b07e5-04f2-4dc3-80ad-ba8105cb4c82 is going to be created. [ 664.914746] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5435d71f-3832-4f11-be57-bef3011dd7b7',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.928210] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.928210] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.928210] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.928210] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.928210] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.951109] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f75b07e5-04f2-4dc3-80ad-ba8105cb4c82 in Status: IN_PROGRESS for 2s [ 665.422398] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.422398] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.422398] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.422398] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.422398] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.422899] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5435d71f-3832-4f11-be57-bef3011dd7b7 is going to be updated. [ 665.461432] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.461604] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.462252] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.462252] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.462463] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.472778] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5435d71f-3832-4f11-be57-bef3011dd7b7 in Status: IN_PROGRESS for 2s [ 666.962262] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f75b07e5-04f2-4dc3-80ad-ba8105cb4c82 in Status: SUCCESS [ 666.962616] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f75b07e5-04f2-4dc3-80ad-ba8105cb4c82" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.484774] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5435d71f-3832-4f11-be57-bef3011dd7b7 in Status: SUCCESS [ 667.485071] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5435d71f-3832-4f11-be57-bef3011dd7b7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.485236] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5435d71f-3832-4f11-be57-bef3011dd7b7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.485465] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5435d71f-3832-4f11-be57-bef3011dd7b7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.486154] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.486154] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.486154] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.486154] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.486154] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.486154] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5435d71f-3832-4f11-be57-bef3011dd7b7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.486450] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5435d71f-3832-4f11-be57-bef3011dd7b7',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.988851] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-5435d71f-3832-4f11-be57-bef3011dd7b7 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.989207] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5435d71f-3832-4f11-be57-bef3011dd7b7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.989207] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5435d71f-3832-4f11-be57-bef3011dd7b7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.989382] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5435d71f-3832-4f11-be57-bef3011dd7b7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.989518] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.989631] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.989692] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.989847] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.989947] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.990073] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5435d71f-3832-4f11-be57-bef3011dd7b7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.990235] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-5435d71f-3832-4f11-be57-bef3011dd7b7 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.990331] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5435d71f-3832-4f11-be57-bef3011dd7b7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.990391] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5435d71f-3832-4f11-be57-bef3011dd7b7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.990539] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5435d71f-3832-4f11-be57-bef3011dd7b7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.990677] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.990770] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.990830] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.990968] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.991144] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.991244] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5435d71f-3832-4f11-be57-bef3011dd7b7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.991338] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5435d71f-3832-4f11-be57-bef3011dd7b7',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.024937] env[69232]: INFO networking_nsxv3.common.synchronization [None req-9264fe60-8b69-49e6-affa-af1d2d025dd3 None None] Enqueued Resource ID: 795e2be0-65a7-4f92-a18e-27fb7d493165 with Priority: HIGHEST for action port [ 668.025469] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 795e2be0-65a7-4f92-a18e-27fb7d493165 with Priority: HIGHEST for action port [ 668.027863] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-795e2be0-65a7-4f92-a18e-27fb7d493165 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.027966] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-795e2be0-65a7-4f92-a18e-27fb7d493165" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.028031] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-795e2be0-65a7-4f92-a18e-27fb7d493165" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.028601] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-795e2be0-65a7-4f92-a18e-27fb7d493165" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.028745] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('795e2be0-65a7-4f92-a18e-27fb7d493165',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.497295] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5435d71f-3832-4f11-be57-bef3011dd7b7: rpc.has_security_group_logging(os_id): False [ 668.519083] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.519083] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.519083] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.519083] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.519083] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.519083] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.519083] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.519083] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.519083] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.519083] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.519083] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.519083] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.519083] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.519083] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.519083] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.519795] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.524035] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.524035] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.524035] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.524035] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.524035] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5435d71f-3832-4f11-be57-bef3011dd7b7 is going to be updated. [ 668.532629] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 795e2be0-65a7-4f92-a18e-27fb7d493165 [ 668.532629] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.532629] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.532629] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.532629] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.532629] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.532629] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:795e2be0-65a7-4f92-a18e-27fb7d493165 already deleted. [ 668.532629] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-795e2be0-65a7-4f92-a18e-27fb7d493165" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.542356] env[69232]: INFO networking_nsxv3.common.synchronization [req-1e51bef1-b16b-430e-b1f3-1070e908a30c req-498a7486-6ef3-41bd-9fb9-d765e668b5fd tempest-DeleteServersAdminTestJSON-46940546 tempest-DeleteServersAdminTestJSON-46940546-project-member] Enqueued Resource ID: 04c8afd4-5b6b-40d6-827e-7916015a1e43 with Priority: HIGHEST for action security_group_members [ 668.543033] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04c8afd4-5b6b-40d6-827e-7916015a1e43 with Priority: HIGHEST for action security_group_members [ 668.543190] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-04c8afd4-5b6b-40d6-827e-7916015a1e43 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.543319] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04c8afd4-5b6b-40d6-827e-7916015a1e43" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.543387] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04c8afd4-5b6b-40d6-827e-7916015a1e43" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.543594] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04c8afd4-5b6b-40d6-827e-7916015a1e43" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.543747] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.543847] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.543909] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.545467] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.545467] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.545467] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('04c8afd4-5b6b-40d6-827e-7916015a1e43',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.609083] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.609336] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.609421] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.609650] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.609846] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.631191] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5435d71f-3832-4f11-be57-bef3011dd7b7 in Status: IN_PROGRESS for 2s [ 669.050114] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.050114] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.050114] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.050114] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.050114] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.050114] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.050114] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.050114] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.050114] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.050114] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.050114] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 04c8afd4-5b6b-40d6-827e-7916015a1e43 is going to be updated. [ 669.081705] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.082037] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.082145] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.082460] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.082611] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.086609] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock network-225 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.086841] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "network-225" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.086974] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "network-225" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.087297] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "network-225" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.087612] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.087858] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.087858] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.088459] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.088459] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.088459] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 669.088645] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] NeedRegenerationException {{(pid=69232) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 669.088685] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] no value, waiting for create lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 669.088818] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] value creation lock acquired {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 669.088871] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 669.088975] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Calling creation function for not-yet-present value {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 669.089149] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 669.094097] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 04c8afd4-5b6b-40d6-827e-7916015a1e43 in Status: IN_PROGRESS for 2s [ 669.109363] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 669.109535] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69232) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 669.109658] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Released creation lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 669.109835] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "network-225" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.110500] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock port-f3a7bcb1-d8c3-4771-9b61-5d74074b653e taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.110766] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "port-f3a7bcb1-d8c3-4771-9b61-5d74074b653e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.110886] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "port-f3a7bcb1-d8c3-4771-9b61-5d74074b653e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.111257] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "port-f3a7bcb1-d8c3-4771-9b61-5d74074b653e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.111511] env[69232]: DEBUG networking_nsxv3.api.rpc [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f3a7bcb1-d8c3-4771-9b61-5d74074b653e',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.614443] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.615222] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.615222] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.615222] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.615475] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.615524] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Segment Port f3a7bcb1-d8c3-4771-9b61-5d74074b653e not found, creating... [ 669.615793] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.615946] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.616083] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.616324] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.616461] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.616754] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.616927] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.617177] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.617350] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.617399] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.617539] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Resource: SegmentPort with ID: f3a7bcb1-d8c3-4771-9b61-5d74074b653e is going to be created. [ 669.642426] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.642631] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.642753] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.643043] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.643281] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.643514] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "port-f3a7bcb1-d8c3-4771-9b61-5d74074b653e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.405376] env[69232]: INFO networking_nsxv3.common.synchronization [None req-f4e6b60d-c85f-47d0-a0a6-323131b52618 None None] Enqueued Resource ID: e11aac90-d16a-49ab-9e42-ff03fcebe4b3 with Priority: HIGHEST for action port [ 670.407124] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e11aac90-d16a-49ab-9e42-ff03fcebe4b3 with Priority: HIGHEST for action port [ 670.407124] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-e11aac90-d16a-49ab-9e42-ff03fcebe4b3 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.407124] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e11aac90-d16a-49ab-9e42-ff03fcebe4b3" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.407124] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e11aac90-d16a-49ab-9e42-ff03fcebe4b3" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.407124] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e11aac90-d16a-49ab-9e42-ff03fcebe4b3" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.407360] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e11aac90-d16a-49ab-9e42-ff03fcebe4b3',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.432678] env[69232]: INFO networking_nsxv3.common.synchronization [req-5fb8a19d-aba8-495d-9c37-5fa41f949018 req-683b16a0-6546-43b7-826b-70d294ee8905 tempest-SecurityGroupRulesTestJSON-29443989 tempest-SecurityGroupRulesTestJSON-29443989-project-member] Enqueued Resource ID: fefdd383-3f1a-4540-a3cf-1f8b9a6a0eb1 with Priority: HIGHEST for action security_group_rules [ 670.433206] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fefdd383-3f1a-4540-a3cf-1f8b9a6a0eb1 with Priority: HIGHEST for action security_group_rules [ 670.433499] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fefdd383-3f1a-4540-a3cf-1f8b9a6a0eb1 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.434478] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fefdd383-3f1a-4540-a3cf-1f8b9a6a0eb1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.434478] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fefdd383-3f1a-4540-a3cf-1f8b9a6a0eb1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.434478] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fefdd383-3f1a-4540-a3cf-1f8b9a6a0eb1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.434478] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fefdd383-3f1a-4540-a3cf-1f8b9a6a0eb1',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.645543] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5435d71f-3832-4f11-be57-bef3011dd7b7 in Status: SUCCESS [ 670.645833] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5435d71f-3832-4f11-be57-bef3011dd7b7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.859007] env[69232]: INFO networking_nsxv3.common.synchronization [req-1e51bef1-b16b-430e-b1f3-1070e908a30c req-7f9a9848-424e-46f1-a250-75485c3d0c0a service nova] Enqueued Resource ID: 04c8afd4-5b6b-40d6-827e-7916015a1e43 with Priority: HIGHEST for action security_group_rules [ 670.859276] env[69232]: INFO networking_nsxv3.common.synchronization [req-1e51bef1-b16b-430e-b1f3-1070e908a30c req-7f9a9848-424e-46f1-a250-75485c3d0c0a service nova] Enqueued Resource ID: 04c8afd4-5b6b-40d6-827e-7916015a1e43 with Priority: HIGHEST for action security_group_members [ 670.859438] env[69232]: INFO networking_nsxv3.common.synchronization [req-1e51bef1-b16b-430e-b1f3-1070e908a30c req-7f9a9848-424e-46f1-a250-75485c3d0c0a service nova] Enqueued Resource ID: f3a7bcb1-d8c3-4771-9b61-5d74074b653e with Priority: HIGHEST for action port [ 670.860090] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04c8afd4-5b6b-40d6-827e-7916015a1e43 with Priority: HIGHEST for action security_group_rules [ 670.860290] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04c8afd4-5b6b-40d6-827e-7916015a1e43 with Priority: HIGHEST for action security_group_members [ 670.860399] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3a7bcb1-d8c3-4771-9b61-5d74074b653e with Priority: HIGHEST for action port [ 670.860695] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-04c8afd4-5b6b-40d6-827e-7916015a1e43 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.860817] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-04c8afd4-5b6b-40d6-827e-7916015a1e43" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.861045] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-04c8afd4-5b6b-40d6-827e-7916015a1e43" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.861226] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-04c8afd4-5b6b-40d6-827e-7916015a1e43" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.861320] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('04c8afd4-5b6b-40d6-827e-7916015a1e43',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.862774] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-04c8afd4-5b6b-40d6-827e-7916015a1e43 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.862774] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04c8afd4-5b6b-40d6-827e-7916015a1e43" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.862774] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-f3a7bcb1-d8c3-4771-9b61-5d74074b653e taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.862774] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f3a7bcb1-d8c3-4771-9b61-5d74074b653e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.862774] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f3a7bcb1-d8c3-4771-9b61-5d74074b653e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.863059] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f3a7bcb1-d8c3-4771-9b61-5d74074b653e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.863059] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f3a7bcb1-d8c3-4771-9b61-5d74074b653e',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.910175] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e11aac90-d16a-49ab-9e42-ff03fcebe4b3 [ 670.910597] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.910597] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.910715] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.910836] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.911063] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.911063] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e11aac90-d16a-49ab-9e42-ff03fcebe4b3 already deleted. [ 670.911175] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e11aac90-d16a-49ab-9e42-ff03fcebe4b3" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.955538] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.955714] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.955775] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.955977] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.956076] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.956789] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fefdd383-3f1a-4540-a3cf-1f8b9a6a0eb1 already deleted. [ 670.956789] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fefdd383-3f1a-4540-a3cf-1f8b9a6a0eb1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.109533] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 04c8afd4-5b6b-40d6-827e-7916015a1e43 in Status: IN_PROGRESS for 4s [ 671.364894] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-04c8afd4-5b6b-40d6-827e-7916015a1e43 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.365201] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04c8afd4-5b6b-40d6-827e-7916015a1e43" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.365397] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f3a7bcb1-d8c3-4771-9b61-5d74074b653e with status ACTIVE [ 671.366854] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.366854] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.366854] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.366854] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.366854] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.366854] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.366854] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.366854] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.366854] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.366854] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.366854] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.366854] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.367401] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.367401] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.367401] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.367401] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f3a7bcb1-d8c3-4771-9b61-5d74074b653e is going to be updated. [ 671.398021] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.398317] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.398317] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.398543] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.398796] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.398991] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f3a7bcb1-d8c3-4771-9b61-5d74074b653e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.531723] env[69232]: INFO networking_nsxv3.common.synchronization [req-5e3ac712-5419-4e92-824e-655f5460de28 req-3cf855d1-18a3-45fb-ba2b-8e216e2740d9 tempest-FloatingIPsAssociationNegativeTestJSON-224180773 tempest-FloatingIPsAssociationNegativeTestJSON-224180773-project-member] Enqueued Resource ID: 4046c2da-b145-4a23-9fac-fd79697872c1 with Priority: HIGHEST for action security_group_members [ 671.533314] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4046c2da-b145-4a23-9fac-fd79697872c1 with Priority: HIGHEST for action security_group_members [ 671.533314] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-4046c2da-b145-4a23-9fac-fd79697872c1 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.533314] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4046c2da-b145-4a23-9fac-fd79697872c1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.533314] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4046c2da-b145-4a23-9fac-fd79697872c1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.536899] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4046c2da-b145-4a23-9fac-fd79697872c1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.537158] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.537324] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.537324] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.537687] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.537687] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.537687] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4046c2da-b145-4a23-9fac-fd79697872c1',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.044020] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.044719] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.044719] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.044719] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.044719] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.044908] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.044908] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.045019] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.045146] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.045219] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.045292] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4046c2da-b145-4a23-9fac-fd79697872c1 is going to be updated. [ 672.077788] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.077889] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.077960] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.078195] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.078358] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.088929] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4046c2da-b145-4a23-9fac-fd79697872c1 in Status: IN_PROGRESS for 2s [ 672.544603] env[69232]: INFO networking_nsxv3.common.synchronization [req-1412c519-6fea-419f-877a-07a388cc8e0f req-5caaf5dd-07fa-4f5e-a7af-ea2efe44117f tempest-AttachInterfacesV270Test-801604483 tempest-AttachInterfacesV270Test-801604483-project-member] Enqueued Resource ID: 9863f261-b349-427a-acad-78b2e3cc35a0 with Priority: HIGHEST for action security_group_members [ 672.545218] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9863f261-b349-427a-acad-78b2e3cc35a0 with Priority: HIGHEST for action security_group_members [ 672.545624] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-9863f261-b349-427a-acad-78b2e3cc35a0 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.545775] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9863f261-b349-427a-acad-78b2e3cc35a0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.545854] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9863f261-b349-427a-acad-78b2e3cc35a0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.550330] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9863f261-b349-427a-acad-78b2e3cc35a0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.550486] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.550561] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.550648] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.551292] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.551496] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.551496] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9863f261-b349-427a-acad-78b2e3cc35a0',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.055522] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.055754] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.055807] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.056029] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.056131] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.056347] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.056447] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.056508] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.056717] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.056818] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.056911] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9863f261-b349-427a-acad-78b2e3cc35a0 is going to be updated. [ 673.109020] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.109305] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.109367] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.109575] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.109715] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.130247] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 04c8afd4-5b6b-40d6-827e-7916015a1e43 in Status: SUCCESS [ 673.130486] env[69232]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 04c8afd4-5b6b-40d6-827e-7916015a1e43 deletion is rescheduled due to dependency. [ 673.130564] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04c8afd4-5b6b-40d6-827e-7916015a1e43" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.130758] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04c8afd4-5b6b-40d6-827e-7916015a1e43" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.131016] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04c8afd4-5b6b-40d6-827e-7916015a1e43" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.131553] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.131553] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.131553] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.131817] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.131817] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.131817] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('04c8afd4-5b6b-40d6-827e-7916015a1e43',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.138409] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9863f261-b349-427a-acad-78b2e3cc35a0 in Status: IN_PROGRESS for 2s [ 673.639398] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('04c8afd4-5b6b-40d6-827e-7916015a1e43',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.102747] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4046c2da-b145-4a23-9fac-fd79697872c1 in Status: IN_PROGRESS for 4s [ 674.144305] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('04c8afd4-5b6b-40d6-827e-7916015a1e43',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.346478] env[69232]: INFO networking_nsxv3.common.synchronization [req-75b6bab0-210f-4729-a8dc-5c2e4baab97a req-ee9e3c79-4175-4f88-bb9b-4f0cc6220084 tempest-ServerDiagnosticsNegativeTest-1135522305 tempest-ServerDiagnosticsNegativeTest-1135522305-project-member] Enqueued Resource ID: 51567675-5d85-4a23-9a2e-1353be4f6ecc with Priority: HIGHEST for action security_group_members [ 674.346902] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 51567675-5d85-4a23-9a2e-1353be4f6ecc with Priority: HIGHEST for action security_group_members [ 674.347348] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-51567675-5d85-4a23-9a2e-1353be4f6ecc taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.347565] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-51567675-5d85-4a23-9a2e-1353be4f6ecc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.347659] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-51567675-5d85-4a23-9a2e-1353be4f6ecc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.347856] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-51567675-5d85-4a23-9a2e-1353be4f6ecc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.348033] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.348189] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.348189] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.348356] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.348441] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.348563] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('51567675-5d85-4a23-9a2e-1353be4f6ecc',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.647330] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.647330] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.647831] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.647831] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.647831] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.647831] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 04c8afd4-5b6b-40d6-827e-7916015a1e43 is going to be updated. [ 674.683316] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.683316] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.683316] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.683699] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.683699] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.696547] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 04c8afd4-5b6b-40d6-827e-7916015a1e43 in Status: IN_PROGRESS for 2s [ 674.851318] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.851598] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.851829] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.853363] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.853545] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.853950] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.854344] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.854344] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.854344] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.854478] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.854512] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 51567675-5d85-4a23-9a2e-1353be4f6ecc already deleted. [ 674.854580] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-51567675-5d85-4a23-9a2e-1353be4f6ecc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.152913] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock network-225 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.153390] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "network-225" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.153632] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "network-225" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.156334] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "network-225" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.157117] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.157490] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.157604] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.158061] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.158268] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.158686] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 675.159129] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] NeedRegenerationException {{(pid=69232) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 675.159129] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] no value, waiting for create lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 675.159384] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] value creation lock acquired {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 675.159464] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 675.159932] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Calling creation function for not-yet-present value {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 675.159932] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 675.162492] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9863f261-b349-427a-acad-78b2e3cc35a0 in Status: SUCCESS [ 675.162774] env[69232]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9863f261-b349-427a-acad-78b2e3cc35a0 deletion is rescheduled due to dependency. [ 675.162956] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9863f261-b349-427a-acad-78b2e3cc35a0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.193752] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 675.193925] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Cache value generated in 0.034 seconds for key(s): 'zone-id' {{(pid=69232) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 675.194090] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Released creation lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 675.194278] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "network-225" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.194600] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock port-ea5e3e0a-4575-4a78-a26e-86e5bd27e5b2 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.194820] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "port-ea5e3e0a-4575-4a78-a26e-86e5bd27e5b2" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.194963] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "port-ea5e3e0a-4575-4a78-a26e-86e5bd27e5b2" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.195334] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "port-ea5e3e0a-4575-4a78-a26e-86e5bd27e5b2" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.195474] env[69232]: DEBUG networking_nsxv3.api.rpc [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ea5e3e0a-4575-4a78-a26e-86e5bd27e5b2',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.700951] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.700951] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.700951] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.700951] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.700951] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.700951] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Segment Port ea5e3e0a-4575-4a78-a26e-86e5bd27e5b2 not found, creating... [ 675.700951] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.700951] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.700951] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.700951] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.700951] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.701771] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.702394] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.702575] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.702889] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.703280] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.703550] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Resource: SegmentPort with ID: ea5e3e0a-4575-4a78-a26e-86e5bd27e5b2 is going to be created. [ 675.726941] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.727428] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.727633] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.728094] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.728793] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.729286] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "port-ea5e3e0a-4575-4a78-a26e-86e5bd27e5b2" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.066859] env[69232]: INFO networking_nsxv3.common.synchronization [None req-f55bf86e-e7e7-4421-8d96-2921a24ebd56 None None] Enqueued Resource ID: c3b800d4-a42d-4c6e-92e2-e83e9ecf3e63 with Priority: HIGHEST for action port [ 676.067981] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3b800d4-a42d-4c6e-92e2-e83e9ecf3e63 with Priority: HIGHEST for action port [ 676.069181] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-c3b800d4-a42d-4c6e-92e2-e83e9ecf3e63 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.069181] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c3b800d4-a42d-4c6e-92e2-e83e9ecf3e63" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.069181] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c3b800d4-a42d-4c6e-92e2-e83e9ecf3e63" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.069471] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c3b800d4-a42d-4c6e-92e2-e83e9ecf3e63" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.069590] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c3b800d4-a42d-4c6e-92e2-e83e9ecf3e63',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.115987] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4046c2da-b145-4a23-9fac-fd79697872c1 in Status: SUCCESS [ 676.115987] env[69232]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4046c2da-b145-4a23-9fac-fd79697872c1 deletion is rescheduled due to dependency. [ 676.117245] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4046c2da-b145-4a23-9fac-fd79697872c1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.575227] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c3b800d4-a42d-4c6e-92e2-e83e9ecf3e63 [ 676.575227] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.575227] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.575227] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.575227] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.575227] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.575227] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c3b800d4-a42d-4c6e-92e2-e83e9ecf3e63 already deleted. [ 676.575227] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c3b800d4-a42d-4c6e-92e2-e83e9ecf3e63" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.706853] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 04c8afd4-5b6b-40d6-827e-7916015a1e43 in Status: SUCCESS [ 676.706853] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04c8afd4-5b6b-40d6-827e-7916015a1e43" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.707442] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04c8afd4-5b6b-40d6-827e-7916015a1e43" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.707442] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04c8afd4-5b6b-40d6-827e-7916015a1e43" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.707442] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.707719] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.707799] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.707979] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.709021] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.709021] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04c8afd4-5b6b-40d6-827e-7916015a1e43" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.709021] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('04c8afd4-5b6b-40d6-827e-7916015a1e43',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.859946] env[69232]: INFO networking_nsxv3.common.synchronization [req-75b6bab0-210f-4729-a8dc-5c2e4baab97a req-4328cc21-bbc7-422d-82b1-9dff18f8b8dc service nova] Enqueued Resource ID: 51567675-5d85-4a23-9a2e-1353be4f6ecc with Priority: HIGHEST for action security_group_rules [ 676.859946] env[69232]: INFO networking_nsxv3.common.synchronization [req-75b6bab0-210f-4729-a8dc-5c2e4baab97a req-4328cc21-bbc7-422d-82b1-9dff18f8b8dc service nova] Enqueued Resource ID: 51567675-5d85-4a23-9a2e-1353be4f6ecc with Priority: HIGHEST for action security_group_members [ 676.859946] env[69232]: INFO networking_nsxv3.common.synchronization [req-75b6bab0-210f-4729-a8dc-5c2e4baab97a req-4328cc21-bbc7-422d-82b1-9dff18f8b8dc service nova] Enqueued Resource ID: ea5e3e0a-4575-4a78-a26e-86e5bd27e5b2 with Priority: HIGHEST for action port [ 676.859946] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 51567675-5d85-4a23-9a2e-1353be4f6ecc with Priority: HIGHEST for action security_group_rules [ 676.859946] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 51567675-5d85-4a23-9a2e-1353be4f6ecc with Priority: HIGHEST for action security_group_members [ 676.859946] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea5e3e0a-4575-4a78-a26e-86e5bd27e5b2 with Priority: HIGHEST for action port [ 676.860298] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-51567675-5d85-4a23-9a2e-1353be4f6ecc taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.860427] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-51567675-5d85-4a23-9a2e-1353be4f6ecc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.860490] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-51567675-5d85-4a23-9a2e-1353be4f6ecc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.860804] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-51567675-5d85-4a23-9a2e-1353be4f6ecc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.860927] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('51567675-5d85-4a23-9a2e-1353be4f6ecc',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.864318] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-51567675-5d85-4a23-9a2e-1353be4f6ecc taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.864464] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-51567675-5d85-4a23-9a2e-1353be4f6ecc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.864464] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-51567675-5d85-4a23-9a2e-1353be4f6ecc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.864678] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-51567675-5d85-4a23-9a2e-1353be4f6ecc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.864815] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.864919] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.864980] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.865175] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.865266] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.865383] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('51567675-5d85-4a23-9a2e-1353be4f6ecc',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.871604] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-ea5e3e0a-4575-4a78-a26e-86e5bd27e5b2 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.871604] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ea5e3e0a-4575-4a78-a26e-86e5bd27e5b2" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.871604] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ea5e3e0a-4575-4a78-a26e-86e5bd27e5b2" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.871604] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ea5e3e0a-4575-4a78-a26e-86e5bd27e5b2" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.871604] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ea5e3e0a-4575-4a78-a26e-86e5bd27e5b2',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.213808] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-04c8afd4-5b6b-40d6-827e-7916015a1e43 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.213808] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04c8afd4-5b6b-40d6-827e-7916015a1e43" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.213808] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04c8afd4-5b6b-40d6-827e-7916015a1e43" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.213808] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04c8afd4-5b6b-40d6-827e-7916015a1e43" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.214146] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.214412] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.214412] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.214570] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.214622] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.214722] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04c8afd4-5b6b-40d6-827e-7916015a1e43" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.214908] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-04c8afd4-5b6b-40d6-827e-7916015a1e43 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.215070] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04c8afd4-5b6b-40d6-827e-7916015a1e43" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.215230] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04c8afd4-5b6b-40d6-827e-7916015a1e43" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.215648] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04c8afd4-5b6b-40d6-827e-7916015a1e43" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.215843] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.216075] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.216152] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.216333] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.216411] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.216521] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04c8afd4-5b6b-40d6-827e-7916015a1e43" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.216642] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('04c8afd4-5b6b-40d6-827e-7916015a1e43',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.376273] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-51567675-5d85-4a23-9a2e-1353be4f6ecc taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.376273] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-51567675-5d85-4a23-9a2e-1353be4f6ecc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.376273] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('51567675-5d85-4a23-9a2e-1353be4f6ecc',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.376273] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ea5e3e0a-4575-4a78-a26e-86e5bd27e5b2 with status ACTIVE [ 677.376273] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.376273] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.376273] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.376273] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.376273] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.376273] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.376273] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.376273] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.376273] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.376273] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.376857] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.376857] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.376857] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.376857] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.376857] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.376857] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ea5e3e0a-4575-4a78-a26e-86e5bd27e5b2 is going to be updated. [ 677.404315] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.404315] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.404315] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.404315] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.404315] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.404315] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ea5e3e0a-4575-4a78-a26e-86e5bd27e5b2" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.719507] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 04c8afd4-5b6b-40d6-827e-7916015a1e43: rpc.has_security_group_logging(os_id): False [ 677.738919] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.739131] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.739261] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.739440] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.739545] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.739809] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.739907] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.739907] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.740171] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.740171] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.740384] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.740461] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.740525] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.740702] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.740795] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.740996] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.741555] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.741555] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.741768] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.742851] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.742953] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 04c8afd4-5b6b-40d6-827e-7916015a1e43 is going to be updated. [ 677.815154] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.815430] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.815430] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.815580] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.815720] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.828552] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 04c8afd4-5b6b-40d6-827e-7916015a1e43 in Status: IN_PROGRESS for 2s [ 677.881455] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('51567675-5d85-4a23-9a2e-1353be4f6ecc',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.004915] env[69232]: INFO networking_nsxv3.common.synchronization [None req-88dc5805-2036-4358-b184-d48365a3fc82 None None] Enqueued Resource ID: afb5f6cf-f96d-44c3-b6ad-b9c0fb7170ff with Priority: HIGHEST for action port [ 678.005185] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: afb5f6cf-f96d-44c3-b6ad-b9c0fb7170ff with Priority: HIGHEST for action port [ 678.005762] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-afb5f6cf-f96d-44c3-b6ad-b9c0fb7170ff taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.005893] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-afb5f6cf-f96d-44c3-b6ad-b9c0fb7170ff" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.005957] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-afb5f6cf-f96d-44c3-b6ad-b9c0fb7170ff" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.009310] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-afb5f6cf-f96d-44c3-b6ad-b9c0fb7170ff" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.009310] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('afb5f6cf-f96d-44c3-b6ad-b9c0fb7170ff',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.384630] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.384630] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.384630] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.384630] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.384630] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.384630] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 51567675-5d85-4a23-9a2e-1353be4f6ecc is going to be created. [ 678.412693] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.412911] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.412911] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.413150] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.413331] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.426216] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 51567675-5d85-4a23-9a2e-1353be4f6ecc in Status: UNINITIALIZED for 2s [ 678.511573] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port afb5f6cf-f96d-44c3-b6ad-b9c0fb7170ff [ 678.511874] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.513213] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.513213] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.513213] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.513213] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.513213] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:afb5f6cf-f96d-44c3-b6ad-b9c0fb7170ff already deleted. [ 678.513213] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-afb5f6cf-f96d-44c3-b6ad-b9c0fb7170ff" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.978062] env[69232]: INFO networking_nsxv3.common.synchronization [req-43cc2671-692a-4fcf-8abc-e3f98a1191f6 req-e7d79ec1-fc1e-4f89-9985-b266b2c0e96b tempest-AttachInterfacesUnderV243Test-115986106 tempest-AttachInterfacesUnderV243Test-115986106-project-member] Enqueued Resource ID: 393d1484-2236-4219-a1eb-b4013eec039a with Priority: HIGHEST for action security_group_members [ 678.978774] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 393d1484-2236-4219-a1eb-b4013eec039a with Priority: HIGHEST for action security_group_members [ 678.979281] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-393d1484-2236-4219-a1eb-b4013eec039a taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.979444] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-393d1484-2236-4219-a1eb-b4013eec039a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.979552] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-393d1484-2236-4219-a1eb-b4013eec039a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.979895] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-393d1484-2236-4219-a1eb-b4013eec039a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.980142] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.980283] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.980351] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.980526] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.980614] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.980731] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('393d1484-2236-4219-a1eb-b4013eec039a',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.485020] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.485232] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.485315] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.485670] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.485795] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.486181] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.486395] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.486462] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.486766] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.486937] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.487037] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 393d1484-2236-4219-a1eb-b4013eec039a already deleted. [ 679.487179] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-393d1484-2236-4219-a1eb-b4013eec039a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.795308] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock network-240 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.795526] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "network-240" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.795627] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "network-240" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.795975] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "network-240" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.796340] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.796522] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.796846] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.797125] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.797275] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.797487] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 679.797658] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] NeedRegenerationException {{(pid=69232) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 679.797713] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] no value, waiting for create lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 679.797807] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] value creation lock acquired {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 679.797916] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 679.798031] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Calling creation function for not-yet-present value {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 679.798165] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 679.820397] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 679.820699] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69232) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 679.820895] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Released creation lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 679.821054] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "network-240" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.821451] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock port-7706e09f-3fd5-433f-8122-b1b583c71be8 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.821649] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "port-7706e09f-3fd5-433f-8122-b1b583c71be8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.821824] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "port-7706e09f-3fd5-433f-8122-b1b583c71be8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.822114] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "port-7706e09f-3fd5-433f-8122-b1b583c71be8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.822323] env[69232]: DEBUG networking_nsxv3.api.rpc [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7706e09f-3fd5-433f-8122-b1b583c71be8',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.843074] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 04c8afd4-5b6b-40d6-827e-7916015a1e43 in Status: SUCCESS [ 679.843423] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-04c8afd4-5b6b-40d6-827e-7916015a1e43" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.327402] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.327836] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.327836] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.328266] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.328305] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.328508] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Segment Port 7706e09f-3fd5-433f-8122-b1b583c71be8 not found, creating... [ 680.328854] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.329051] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.329320] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.329959] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.329959] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.329959] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.330222] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.330222] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.331029] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.331029] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.331029] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Resource: SegmentPort with ID: 7706e09f-3fd5-433f-8122-b1b583c71be8 is going to be created. [ 680.355592] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.355856] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.355969] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.356249] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.356483] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.356713] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "port-7706e09f-3fd5-433f-8122-b1b583c71be8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.435474] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 51567675-5d85-4a23-9a2e-1353be4f6ecc in Status: SUCCESS [ 680.435754] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-51567675-5d85-4a23-9a2e-1353be4f6ecc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.435936] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-51567675-5d85-4a23-9a2e-1353be4f6ecc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.436172] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-51567675-5d85-4a23-9a2e-1353be4f6ecc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.436368] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.436483] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.436544] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.436703] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.436780] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.436869] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-51567675-5d85-4a23-9a2e-1353be4f6ecc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.436955] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('51567675-5d85-4a23-9a2e-1353be4f6ecc',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.942217] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-51567675-5d85-4a23-9a2e-1353be4f6ecc taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.942418] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-51567675-5d85-4a23-9a2e-1353be4f6ecc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.942547] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-51567675-5d85-4a23-9a2e-1353be4f6ecc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.942793] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-51567675-5d85-4a23-9a2e-1353be4f6ecc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.942972] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.943127] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.943237] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.943484] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.943771] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.943771] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-51567675-5d85-4a23-9a2e-1353be4f6ecc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.944030] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-51567675-5d85-4a23-9a2e-1353be4f6ecc taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.944103] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-51567675-5d85-4a23-9a2e-1353be4f6ecc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.944171] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-51567675-5d85-4a23-9a2e-1353be4f6ecc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.944334] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-51567675-5d85-4a23-9a2e-1353be4f6ecc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.944512] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.944672] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.944773] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.944909] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.944988] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.947039] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-51567675-5d85-4a23-9a2e-1353be4f6ecc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.947039] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('51567675-5d85-4a23-9a2e-1353be4f6ecc',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.448888] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 51567675-5d85-4a23-9a2e-1353be4f6ecc: rpc.has_security_group_logging(os_id): False [ 681.467391] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.467620] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.467697] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.467976] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.468104] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.468350] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.468480] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.468548] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.468739] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.468809] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.469025] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.469137] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.469228] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.469405] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.469492] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.469676] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.469770] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.469850] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.470011] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.470210] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.470368] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 51567675-5d85-4a23-9a2e-1353be4f6ecc is going to be created. [ 681.535452] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.535643] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.535726] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.535979] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.536210] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.553193] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 51567675-5d85-4a23-9a2e-1353be4f6ecc in Status: IN_PROGRESS for 2s [ 681.929957] env[69232]: INFO networking_nsxv3.common.synchronization [req-9082c573-7d62-404f-921f-1b044cff4c01 req-442b2039-af13-4f0a-befb-df936e10eb21 tempest-ServersNegativeTestMultiTenantJSON-1523884426 tempest-ServersNegativeTestMultiTenantJSON-1523884426-project-member] Enqueued Resource ID: d95c4c9e-2568-4fbb-8231-ae683e08215e with Priority: HIGHEST for action security_group_members [ 681.931116] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d95c4c9e-2568-4fbb-8231-ae683e08215e with Priority: HIGHEST for action security_group_members [ 681.931239] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-d95c4c9e-2568-4fbb-8231-ae683e08215e taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.931600] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d95c4c9e-2568-4fbb-8231-ae683e08215e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.931600] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d95c4c9e-2568-4fbb-8231-ae683e08215e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.931844] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d95c4c9e-2568-4fbb-8231-ae683e08215e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.932424] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.932424] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.932424] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.932593] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.932626] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.932729] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d95c4c9e-2568-4fbb-8231-ae683e08215e',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.384230] env[69232]: INFO networking_nsxv3.common.synchronization [req-43cc2671-692a-4fcf-8abc-e3f98a1191f6 req-e0e65059-624a-4c50-b204-a06a440b4171 service nova] Enqueued Resource ID: 393d1484-2236-4219-a1eb-b4013eec039a with Priority: HIGHEST for action security_group_rules [ 682.384230] env[69232]: INFO networking_nsxv3.common.synchronization [req-43cc2671-692a-4fcf-8abc-e3f98a1191f6 req-e0e65059-624a-4c50-b204-a06a440b4171 service nova] Enqueued Resource ID: 393d1484-2236-4219-a1eb-b4013eec039a with Priority: HIGHEST for action security_group_members [ 682.384230] env[69232]: INFO networking_nsxv3.common.synchronization [req-43cc2671-692a-4fcf-8abc-e3f98a1191f6 req-e0e65059-624a-4c50-b204-a06a440b4171 service nova] Enqueued Resource ID: 7706e09f-3fd5-433f-8122-b1b583c71be8 with Priority: HIGHEST for action port [ 682.384230] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 393d1484-2236-4219-a1eb-b4013eec039a with Priority: HIGHEST for action security_group_rules [ 682.384883] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 393d1484-2236-4219-a1eb-b4013eec039a with Priority: HIGHEST for action security_group_members [ 682.385045] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7706e09f-3fd5-433f-8122-b1b583c71be8 with Priority: HIGHEST for action port [ 682.385326] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-393d1484-2236-4219-a1eb-b4013eec039a taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.385449] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-393d1484-2236-4219-a1eb-b4013eec039a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.385513] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-393d1484-2236-4219-a1eb-b4013eec039a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.385714] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-393d1484-2236-4219-a1eb-b4013eec039a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.385793] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('393d1484-2236-4219-a1eb-b4013eec039a',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.386948] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-393d1484-2236-4219-a1eb-b4013eec039a taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.387070] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-393d1484-2236-4219-a1eb-b4013eec039a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.387143] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-393d1484-2236-4219-a1eb-b4013eec039a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.387334] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-393d1484-2236-4219-a1eb-b4013eec039a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.387491] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.387591] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.387653] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.387801] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.387888] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.387982] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('393d1484-2236-4219-a1eb-b4013eec039a',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.388863] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-7706e09f-3fd5-433f-8122-b1b583c71be8 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.388941] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7706e09f-3fd5-433f-8122-b1b583c71be8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.389038] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7706e09f-3fd5-433f-8122-b1b583c71be8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.389218] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7706e09f-3fd5-433f-8122-b1b583c71be8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.389297] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7706e09f-3fd5-433f-8122-b1b583c71be8',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.435722] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.435893] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.435940] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.436254] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.436402] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.436650] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.436770] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.436838] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.436998] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.437111] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.437202] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d95c4c9e-2568-4fbb-8231-ae683e08215e already deleted. [ 682.437283] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d95c4c9e-2568-4fbb-8231-ae683e08215e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.891845] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-393d1484-2236-4219-a1eb-b4013eec039a taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.892184] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-393d1484-2236-4219-a1eb-b4013eec039a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.892184] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7706e09f-3fd5-433f-8122-b1b583c71be8 with status ACTIVE [ 682.892356] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.892466] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.892670] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.892755] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.892846] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.893021] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.893112] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.893176] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.893334] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.893410] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.893582] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.893675] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.893732] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.893867] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.893939] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.894037] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7706e09f-3fd5-433f-8122-b1b583c71be8 is going to be updated. [ 682.897574] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('393d1484-2236-4219-a1eb-b4013eec039a',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.928907] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.929179] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.929179] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.929442] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.929577] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.929901] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7706e09f-3fd5-433f-8122-b1b583c71be8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.941038] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock network-44 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.941038] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "network-44" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.941172] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "network-44" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.941505] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "network-44" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.941784] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.942100] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.942318] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.942566] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.942714] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.942926] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 682.943050] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] NeedRegenerationException {{(pid=69232) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 682.943161] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] no value, waiting for create lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 682.943328] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] value creation lock acquired {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 682.943449] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 682.943581] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Calling creation function for not-yet-present value {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 682.943690] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 682.962546] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 682.962769] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69232) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 682.962853] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Released creation lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 682.963046] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "network-44" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.963371] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock port-6b2a3175-0ad3-4d4c-8925-39f5205d2c11 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.963549] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "port-6b2a3175-0ad3-4d4c-8925-39f5205d2c11" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.963680] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "port-6b2a3175-0ad3-4d4c-8925-39f5205d2c11" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.963997] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "port-6b2a3175-0ad3-4d4c-8925-39f5205d2c11" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.964156] env[69232]: DEBUG networking_nsxv3.api.rpc [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6b2a3175-0ad3-4d4c-8925-39f5205d2c11',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.402108] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('393d1484-2236-4219-a1eb-b4013eec039a',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.467088] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.467376] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.467507] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.467806] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.467957] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.468728] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Segment Port 6b2a3175-0ad3-4d4c-8925-39f5205d2c11 not found, creating... [ 683.468728] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.468728] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.468728] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.469108] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.469108] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.469442] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.469650] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.469756] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.470041] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.470112] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.470298] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Resource: SegmentPort with ID: 6b2a3175-0ad3-4d4c-8925-39f5205d2c11 is going to be created. [ 683.500413] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.500640] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.500765] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.501061] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.501423] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.501609] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "port-6b2a3175-0ad3-4d4c-8925-39f5205d2c11" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.568788] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 51567675-5d85-4a23-9a2e-1353be4f6ecc in Status: SUCCESS [ 683.569050] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-51567675-5d85-4a23-9a2e-1353be4f6ecc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.904397] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.906362] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.906362] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.906362] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.906362] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.906362] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 393d1484-2236-4219-a1eb-b4013eec039a is going to be created. [ 683.936014] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.936186] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.936255] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.936473] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.936637] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.952339] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 393d1484-2236-4219-a1eb-b4013eec039a in Status: UNINITIALIZED for 2s [ 684.839026] env[69232]: INFO networking_nsxv3.common.synchronization [req-9082c573-7d62-404f-921f-1b044cff4c01 req-8b429b26-d106-49a5-a77a-c012ed3cd2c6 service nova] Enqueued Resource ID: d95c4c9e-2568-4fbb-8231-ae683e08215e with Priority: HIGHEST for action security_group_rules [ 684.839026] env[69232]: INFO networking_nsxv3.common.synchronization [req-9082c573-7d62-404f-921f-1b044cff4c01 req-8b429b26-d106-49a5-a77a-c012ed3cd2c6 service nova] Enqueued Resource ID: d95c4c9e-2568-4fbb-8231-ae683e08215e with Priority: HIGHEST for action security_group_members [ 684.839026] env[69232]: INFO networking_nsxv3.common.synchronization [req-9082c573-7d62-404f-921f-1b044cff4c01 req-8b429b26-d106-49a5-a77a-c012ed3cd2c6 service nova] Enqueued Resource ID: 6b2a3175-0ad3-4d4c-8925-39f5205d2c11 with Priority: HIGHEST for action port [ 684.839026] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d95c4c9e-2568-4fbb-8231-ae683e08215e with Priority: HIGHEST for action security_group_rules [ 684.839026] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d95c4c9e-2568-4fbb-8231-ae683e08215e with Priority: HIGHEST for action security_group_members [ 684.839026] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b2a3175-0ad3-4d4c-8925-39f5205d2c11 with Priority: HIGHEST for action port [ 684.839026] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d95c4c9e-2568-4fbb-8231-ae683e08215e taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.839399] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d95c4c9e-2568-4fbb-8231-ae683e08215e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.839507] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d95c4c9e-2568-4fbb-8231-ae683e08215e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.839798] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d95c4c9e-2568-4fbb-8231-ae683e08215e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.839982] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d95c4c9e-2568-4fbb-8231-ae683e08215e',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.840947] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-d95c4c9e-2568-4fbb-8231-ae683e08215e taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.841141] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d95c4c9e-2568-4fbb-8231-ae683e08215e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.841249] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d95c4c9e-2568-4fbb-8231-ae683e08215e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.841469] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d95c4c9e-2568-4fbb-8231-ae683e08215e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.841671] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.841814] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.841913] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.842122] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.842303] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.842418] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d95c4c9e-2568-4fbb-8231-ae683e08215e',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.843731] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-6b2a3175-0ad3-4d4c-8925-39f5205d2c11 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.843731] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6b2a3175-0ad3-4d4c-8925-39f5205d2c11" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.843731] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6b2a3175-0ad3-4d4c-8925-39f5205d2c11" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.843931] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6b2a3175-0ad3-4d4c-8925-39f5205d2c11" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.844052] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6b2a3175-0ad3-4d4c-8925-39f5205d2c11',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.346897] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d95c4c9e-2568-4fbb-8231-ae683e08215e',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.346897] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-d95c4c9e-2568-4fbb-8231-ae683e08215e taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.346897] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d95c4c9e-2568-4fbb-8231-ae683e08215e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.347326] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6b2a3175-0ad3-4d4c-8925-39f5205d2c11 with status ACTIVE [ 685.347362] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.347478] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.347543] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.347738] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.347824] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.347987] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.348115] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.348185] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.348338] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.348411] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.348581] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.348726] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.348726] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.348907] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.348950] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.349011] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6b2a3175-0ad3-4d4c-8925-39f5205d2c11 is going to be updated. [ 685.373303] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.373472] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.373546] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.373789] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.373940] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.375176] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6b2a3175-0ad3-4d4c-8925-39f5205d2c11" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.805525] env[69232]: INFO networking_nsxv3.common.synchronization [req-81205431-5241-4915-b0c8-4ba891a3615e req-5c7f6689-fb84-48ee-a244-b24d0beeb892 tempest-ServerRescueNegativeTestJSON-737130981 tempest-ServerRescueNegativeTestJSON-737130981-project-member] Enqueued Resource ID: f75b07e5-04f2-4dc3-80ad-ba8105cb4c82 with Priority: HIGHEST for action security_group_members [ 685.805525] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f75b07e5-04f2-4dc3-80ad-ba8105cb4c82 with Priority: HIGHEST for action security_group_members [ 685.805525] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-f75b07e5-04f2-4dc3-80ad-ba8105cb4c82 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.807874] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f75b07e5-04f2-4dc3-80ad-ba8105cb4c82" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.808087] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f75b07e5-04f2-4dc3-80ad-ba8105cb4c82" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.809663] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f75b07e5-04f2-4dc3-80ad-ba8105cb4c82" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.809663] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.809663] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.809663] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.809663] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.809663] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.809663] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f75b07e5-04f2-4dc3-80ad-ba8105cb4c82',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.847519] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d95c4c9e-2568-4fbb-8231-ae683e08215e',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.961538] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 393d1484-2236-4219-a1eb-b4013eec039a in Status: SUCCESS [ 685.961694] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-393d1484-2236-4219-a1eb-b4013eec039a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.961767] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-393d1484-2236-4219-a1eb-b4013eec039a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.962000] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-393d1484-2236-4219-a1eb-b4013eec039a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.962185] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.962302] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.962366] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.962529] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.962608] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.962695] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-393d1484-2236-4219-a1eb-b4013eec039a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.962784] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('393d1484-2236-4219-a1eb-b4013eec039a',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.312795] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f75b07e5-04f2-4dc3-80ad-ba8105cb4c82',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.355550] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.355924] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.355924] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.356137] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.356137] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.359024] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d95c4c9e-2568-4fbb-8231-ae683e08215e is going to be created. [ 686.390450] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.390450] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.390450] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.390450] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.390450] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.402190] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d95c4c9e-2568-4fbb-8231-ae683e08215e in Status: UNINITIALIZED for 2s [ 686.469100] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('393d1484-2236-4219-a1eb-b4013eec039a',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.814579] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f75b07e5-04f2-4dc3-80ad-ba8105cb4c82',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.861703] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock network-887 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.861886] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "network-887" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.862031] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "network-887" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.862446] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "network-887" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.862590] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.862827] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.862827] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.863021] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.863190] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.863418] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 686.863547] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] NeedRegenerationException {{(pid=69232) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 686.863652] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] no value, waiting for create lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 686.863756] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] value creation lock acquired {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 686.863892] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 686.863979] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Calling creation function for not-yet-present value {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 686.864133] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 686.911326] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 686.911506] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Cache value generated in 0.047 seconds for key(s): 'zone-id' {{(pid=69232) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 686.911680] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Released creation lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 686.911885] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "network-887" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.912330] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock port-5441c2bb-95b7-4c5c-966c-3a698bb729a3 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.912436] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "port-5441c2bb-95b7-4c5c-966c-3a698bb729a3" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.912586] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "port-5441c2bb-95b7-4c5c-966c-3a698bb729a3" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.913025] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "port-5441c2bb-95b7-4c5c-966c-3a698bb729a3" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.913099] env[69232]: DEBUG networking_nsxv3.api.rpc [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5441c2bb-95b7-4c5c-966c-3a698bb729a3',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.971142] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 393d1484-2236-4219-a1eb-b4013eec039a: rpc.has_security_group_logging(os_id): False [ 686.993027] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.993027] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.993027] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.993289] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.993289] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.993628] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.993736] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.993839] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.994027] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.994090] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.994192] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 393d1484-2236-4219-a1eb-b4013eec039a is going to be created. [ 687.065727] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.066046] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.066046] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.066294] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.066501] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.081420] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 393d1484-2236-4219-a1eb-b4013eec039a in Status: IN_PROGRESS for 2s [ 687.319511] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.319511] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.319511] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.319511] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.319833] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.320160] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f75b07e5-04f2-4dc3-80ad-ba8105cb4c82 is going to be updated. [ 687.351297] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.351438] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.351506] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.351733] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.352462] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.364376] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f75b07e5-04f2-4dc3-80ad-ba8105cb4c82 in Status: IN_PROGRESS for 2s [ 687.416098] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.416462] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.416679] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.418862] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.418862] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.418862] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Segment Port 5441c2bb-95b7-4c5c-966c-3a698bb729a3 not found, creating... [ 687.418862] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.418862] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.418862] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.418862] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.419217] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.420429] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.420429] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.420669] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.421037] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.421277] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.421773] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Resource: SegmentPort with ID: 5441c2bb-95b7-4c5c-966c-3a698bb729a3 is going to be created. [ 687.448276] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.448603] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.448603] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.449257] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.449569] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.450561] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "port-5441c2bb-95b7-4c5c-966c-3a698bb729a3" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.581197] env[69232]: INFO networking_nsxv3.common.synchronization [None req-511031f5-d17c-4a1a-b61d-bbebbcd1f4d6 None None] Enqueued Resource ID: 8dbb6635-fb07-40b8-83f1-d0d3d6cc3d88 with Priority: HIGHEST for action port [ 687.581826] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8dbb6635-fb07-40b8-83f1-d0d3d6cc3d88 with Priority: HIGHEST for action port [ 687.582389] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-8dbb6635-fb07-40b8-83f1-d0d3d6cc3d88 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.582567] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8dbb6635-fb07-40b8-83f1-d0d3d6cc3d88" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.582677] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8dbb6635-fb07-40b8-83f1-d0d3d6cc3d88" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.583013] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8dbb6635-fb07-40b8-83f1-d0d3d6cc3d88" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.583154] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8dbb6635-fb07-40b8-83f1-d0d3d6cc3d88',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.085970] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8dbb6635-fb07-40b8-83f1-d0d3d6cc3d88 [ 688.086429] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.086666] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.086794] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.087214] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.087586] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.087586] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8dbb6635-fb07-40b8-83f1-d0d3d6cc3d88 already deleted. [ 688.087761] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8dbb6635-fb07-40b8-83f1-d0d3d6cc3d88" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.416029] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d95c4c9e-2568-4fbb-8231-ae683e08215e in Status: SUCCESS [ 688.416474] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d95c4c9e-2568-4fbb-8231-ae683e08215e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.417119] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d95c4c9e-2568-4fbb-8231-ae683e08215e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.418306] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d95c4c9e-2568-4fbb-8231-ae683e08215e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.418306] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.418306] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.418306] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.418858] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.418996] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.419151] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d95c4c9e-2568-4fbb-8231-ae683e08215e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.419311] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d95c4c9e-2568-4fbb-8231-ae683e08215e',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.643879] env[69232]: INFO networking_nsxv3.common.synchronization [req-ee30e4ec-01f0-4187-aded-ddcd7a768658 req-67b14974-f412-41f6-8d7c-2fb4d6efecb5 tempest-VolumesAdminNegativeTest-609403025 tempest-VolumesAdminNegativeTest-609403025-project-member] Enqueued Resource ID: 453650db-0c42-4224-8f26-d113b3aaa020 with Priority: HIGHEST for action security_group_members [ 688.643879] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 453650db-0c42-4224-8f26-d113b3aaa020 with Priority: HIGHEST for action security_group_members [ 688.643879] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-453650db-0c42-4224-8f26-d113b3aaa020 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.644106] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-453650db-0c42-4224-8f26-d113b3aaa020" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.644106] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-453650db-0c42-4224-8f26-d113b3aaa020" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.644315] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-453650db-0c42-4224-8f26-d113b3aaa020" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.644470] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.644585] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.645313] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.645873] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.645873] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.646070] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('453650db-0c42-4224-8f26-d113b3aaa020',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.923562] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-d95c4c9e-2568-4fbb-8231-ae683e08215e taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.923562] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d95c4c9e-2568-4fbb-8231-ae683e08215e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.923562] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d95c4c9e-2568-4fbb-8231-ae683e08215e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.923562] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d95c4c9e-2568-4fbb-8231-ae683e08215e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.923562] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.923562] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.923562] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.924140] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.924140] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.924140] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d95c4c9e-2568-4fbb-8231-ae683e08215e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.924977] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-d95c4c9e-2568-4fbb-8231-ae683e08215e taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.924977] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d95c4c9e-2568-4fbb-8231-ae683e08215e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.924977] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d95c4c9e-2568-4fbb-8231-ae683e08215e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.924977] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d95c4c9e-2568-4fbb-8231-ae683e08215e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.924977] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.924977] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.924977] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.924977] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.925335] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.925335] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d95c4c9e-2568-4fbb-8231-ae683e08215e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.925335] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d95c4c9e-2568-4fbb-8231-ae683e08215e',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.095622] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 393d1484-2236-4219-a1eb-b4013eec039a in Status: SUCCESS [ 689.095622] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-393d1484-2236-4219-a1eb-b4013eec039a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.153359] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.153359] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.153359] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.153359] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.153359] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.153359] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.153359] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.153359] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.153359] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.153359] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.153359] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 453650db-0c42-4224-8f26-d113b3aaa020 already deleted. [ 689.153359] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-453650db-0c42-4224-8f26-d113b3aaa020" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.163278] env[69232]: INFO networking_nsxv3.common.synchronization [req-81205431-5241-4915-b0c8-4ba891a3615e req-e61b983a-1091-4a11-a4d0-0830a73bd083 service nova] Enqueued Resource ID: f75b07e5-04f2-4dc3-80ad-ba8105cb4c82 with Priority: HIGHEST for action security_group_rules [ 689.163278] env[69232]: INFO networking_nsxv3.common.synchronization [req-81205431-5241-4915-b0c8-4ba891a3615e req-e61b983a-1091-4a11-a4d0-0830a73bd083 service nova] Enqueued Resource ID: f75b07e5-04f2-4dc3-80ad-ba8105cb4c82 with Priority: HIGHEST for action security_group_members [ 689.163278] env[69232]: INFO networking_nsxv3.common.synchronization [req-81205431-5241-4915-b0c8-4ba891a3615e req-e61b983a-1091-4a11-a4d0-0830a73bd083 service nova] Enqueued Resource ID: 5441c2bb-95b7-4c5c-966c-3a698bb729a3 with Priority: HIGHEST for action port [ 689.165405] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f75b07e5-04f2-4dc3-80ad-ba8105cb4c82 with Priority: HIGHEST for action security_group_rules [ 689.165586] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f75b07e5-04f2-4dc3-80ad-ba8105cb4c82 with Priority: HIGHEST for action security_group_members [ 689.169020] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5441c2bb-95b7-4c5c-966c-3a698bb729a3 with Priority: HIGHEST for action port [ 689.169020] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f75b07e5-04f2-4dc3-80ad-ba8105cb4c82 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.169020] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f75b07e5-04f2-4dc3-80ad-ba8105cb4c82" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.169020] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f75b07e5-04f2-4dc3-80ad-ba8105cb4c82" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.169020] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f75b07e5-04f2-4dc3-80ad-ba8105cb4c82" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.169020] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f75b07e5-04f2-4dc3-80ad-ba8105cb4c82',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.169020] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-f75b07e5-04f2-4dc3-80ad-ba8105cb4c82 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.169020] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f75b07e5-04f2-4dc3-80ad-ba8105cb4c82" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.169020] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-5441c2bb-95b7-4c5c-966c-3a698bb729a3 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.169020] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5441c2bb-95b7-4c5c-966c-3a698bb729a3" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.169020] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5441c2bb-95b7-4c5c-966c-3a698bb729a3" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.169020] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5441c2bb-95b7-4c5c-966c-3a698bb729a3" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.169020] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5441c2bb-95b7-4c5c-966c-3a698bb729a3',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.377543] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f75b07e5-04f2-4dc3-80ad-ba8105cb4c82 in Status: SUCCESS [ 689.377878] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f75b07e5-04f2-4dc3-80ad-ba8105cb4c82" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.377973] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f75b07e5-04f2-4dc3-80ad-ba8105cb4c82" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.378323] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f75b07e5-04f2-4dc3-80ad-ba8105cb4c82" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.378465] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.378586] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.378652] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.378788] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.378911] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.379050] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f75b07e5-04f2-4dc3-80ad-ba8105cb4c82',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.429332] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d95c4c9e-2568-4fbb-8231-ae683e08215e: rpc.has_security_group_logging(os_id): False [ 689.463127] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.463127] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.463127] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.463358] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.463393] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.463841] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.463841] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.463841] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.464042] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.464042] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.464473] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.464473] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.464473] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.464685] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.464685] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.464774] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.464868] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.464930] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.465769] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.465859] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.465955] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d95c4c9e-2568-4fbb-8231-ae683e08215e is going to be created. [ 689.537423] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.537423] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.537423] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.537586] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.537684] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.550484] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d95c4c9e-2568-4fbb-8231-ae683e08215e in Status: IN_PROGRESS for 2s [ 689.672217] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-f75b07e5-04f2-4dc3-80ad-ba8105cb4c82 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.672546] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f75b07e5-04f2-4dc3-80ad-ba8105cb4c82" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.675246] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5441c2bb-95b7-4c5c-966c-3a698bb729a3 with status ACTIVE [ 689.675483] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.675622] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.675693] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.677981] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.677981] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.677981] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.677981] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.677981] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.677981] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.677981] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.677981] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.677981] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.677981] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.677981] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.677981] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.677981] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5441c2bb-95b7-4c5c-966c-3a698bb729a3 is going to be updated. [ 689.729557] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.729557] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.729557] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.729557] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.729557] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.729557] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5441c2bb-95b7-4c5c-966c-3a698bb729a3" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.883102] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f75b07e5-04f2-4dc3-80ad-ba8105cb4c82',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.995908] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock network-246 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.996202] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "network-246" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.996328] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "network-246" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.997054] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "network-246" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.997431] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.997824] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.997824] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.998079] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.998235] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.998616] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 689.998757] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] NeedRegenerationException {{(pid=69232) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 689.998871] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] no value, waiting for create lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 689.998978] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] value creation lock acquired {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 689.999191] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 689.999277] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Calling creation function for not-yet-present value {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 689.999452] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 690.029758] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 690.029758] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=69232) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 690.029758] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Released creation lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 690.029758] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "network-246" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.029758] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock port-e16f0ce7-c502-4746-b060-afc170eacd9d taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.029758] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "port-e16f0ce7-c502-4746-b060-afc170eacd9d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.029758] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "port-e16f0ce7-c502-4746-b060-afc170eacd9d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.031050] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "port-e16f0ce7-c502-4746-b060-afc170eacd9d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.031500] env[69232]: DEBUG networking_nsxv3.api.rpc [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e16f0ce7-c502-4746-b060-afc170eacd9d',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.036141] env[69232]: INFO networking_nsxv3.common.synchronization [req-4a0d9381-8e4d-4efb-bdd4-c7f0d201a2d0 req-9fa8b922-bdde-421c-972b-05ffd9a82ca7 tempest-DeleteServersAdminTestJSON-46940546 tempest-DeleteServersAdminTestJSON-46940546-project-member] Enqueued Resource ID: 04c8afd4-5b6b-40d6-827e-7916015a1e43 with Priority: HIGHEST for action security_group_members [ 690.038597] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04c8afd4-5b6b-40d6-827e-7916015a1e43 with Priority: HIGHEST for action security_group_members [ 690.038597] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-04c8afd4-5b6b-40d6-827e-7916015a1e43 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.038597] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04c8afd4-5b6b-40d6-827e-7916015a1e43" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.038597] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04c8afd4-5b6b-40d6-827e-7916015a1e43" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.038597] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04c8afd4-5b6b-40d6-827e-7916015a1e43" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.038597] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.038597] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.038597] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.038597] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.038597] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.038597] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('04c8afd4-5b6b-40d6-827e-7916015a1e43',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.081093] env[69232]: INFO networking_nsxv3.common.synchronization [req-c61f98f7-f7c2-43f2-8125-a3f4c4bc2012 req-95bf61cd-6496-4364-9bf1-e81c5692858a tempest-FloatingIPsAssociationTestJSON-136976334 tempest-FloatingIPsAssociationTestJSON-136976334-project-member] Enqueued Resource ID: 5435d71f-3832-4f11-be57-bef3011dd7b7 with Priority: HIGHEST for action security_group_members [ 690.081093] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5435d71f-3832-4f11-be57-bef3011dd7b7 with Priority: HIGHEST for action security_group_members [ 690.081093] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-5435d71f-3832-4f11-be57-bef3011dd7b7 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.081093] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5435d71f-3832-4f11-be57-bef3011dd7b7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.081093] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5435d71f-3832-4f11-be57-bef3011dd7b7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.081093] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5435d71f-3832-4f11-be57-bef3011dd7b7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.081593] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.081793] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.081837] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.083256] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.083256] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.083256] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5435d71f-3832-4f11-be57-bef3011dd7b7',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.385604] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f75b07e5-04f2-4dc3-80ad-ba8105cb4c82',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.534537] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.536080] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.536080] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.536080] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.536080] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.536080] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Segment Port e16f0ce7-c502-4746-b060-afc170eacd9d not found, creating... [ 690.536080] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.536391] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.536391] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.536557] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.536750] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.536944] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.538358] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.538611] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.538873] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.539236] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.539236] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Resource: SegmentPort with ID: e16f0ce7-c502-4746-b060-afc170eacd9d is going to be created. [ 690.544450] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.544586] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.544660] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.544851] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.544975] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.545152] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.545240] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.545315] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.545491] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.545562] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.545651] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 04c8afd4-5b6b-40d6-827e-7916015a1e43 is going to be updated. [ 690.566929] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.567192] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.567423] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.567597] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.567827] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.568071] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "port-e16f0ce7-c502-4746-b060-afc170eacd9d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.577578] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.577803] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.577803] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.578120] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.578120] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.586799] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5435d71f-3832-4f11-be57-bef3011dd7b7',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.588508] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 04c8afd4-5b6b-40d6-827e-7916015a1e43 in Status: IN_PROGRESS for 2s [ 690.892808] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.893495] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.893495] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.893691] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.894458] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.897766] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f75b07e5-04f2-4dc3-80ad-ba8105cb4c82 is going to be updated. [ 690.930739] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.931063] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.931063] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.931382] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.931595] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.943475] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f75b07e5-04f2-4dc3-80ad-ba8105cb4c82 in Status: IN_PROGRESS for 2s [ 691.023241] env[69232]: INFO networking_nsxv3.common.synchronization [None req-b2db9a42-7008-4e46-a363-7e9386c732b5 None None] Enqueued Resource ID: 1382ef66-900e-406b-984f-f59270710b0c with Priority: HIGHEST for action port [ 691.023502] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1382ef66-900e-406b-984f-f59270710b0c with Priority: HIGHEST for action port [ 691.024448] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-1382ef66-900e-406b-984f-f59270710b0c taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.025801] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1382ef66-900e-406b-984f-f59270710b0c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.025801] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1382ef66-900e-406b-984f-f59270710b0c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.025801] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1382ef66-900e-406b-984f-f59270710b0c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.025801] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1382ef66-900e-406b-984f-f59270710b0c',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.091361] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5435d71f-3832-4f11-be57-bef3011dd7b7',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.529511] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1382ef66-900e-406b-984f-f59270710b0c [ 691.529760] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.529898] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.529966] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.530381] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.530381] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.530559] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1382ef66-900e-406b-984f-f59270710b0c already deleted. [ 691.530559] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1382ef66-900e-406b-984f-f59270710b0c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.568489] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d95c4c9e-2568-4fbb-8231-ae683e08215e in Status: SUCCESS [ 691.568904] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d95c4c9e-2568-4fbb-8231-ae683e08215e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.593564] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.593787] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.593826] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.594431] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.594530] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.594642] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5435d71f-3832-4f11-be57-bef3011dd7b7 is going to be updated. [ 691.641617] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.641617] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.641617] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.641914] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.641914] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.653963] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5435d71f-3832-4f11-be57-bef3011dd7b7 in Status: IN_PROGRESS for 2s [ 692.125978] env[69232]: INFO networking_nsxv3.common.synchronization [req-75944ff2-2c1c-4408-b3e9-4169b9db67c6 req-b0f2624c-b80c-419a-8487-a010165dfa7d tempest-TenantUsagesTestJSON-1506958894 tempest-TenantUsagesTestJSON-1506958894-project-member] Enqueued Resource ID: 96a06bfd-a7ad-4644-89c3-3168aa1fdf2e with Priority: HIGHEST for action security_group_members [ 692.125978] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 96a06bfd-a7ad-4644-89c3-3168aa1fdf2e with Priority: HIGHEST for action security_group_members [ 692.125978] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-96a06bfd-a7ad-4644-89c3-3168aa1fdf2e taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.125978] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-96a06bfd-a7ad-4644-89c3-3168aa1fdf2e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.125978] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-96a06bfd-a7ad-4644-89c3-3168aa1fdf2e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.125978] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-96a06bfd-a7ad-4644-89c3-3168aa1fdf2e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.125978] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.125978] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.125978] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.125978] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.125978] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.125978] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('96a06bfd-a7ad-4644-89c3-3168aa1fdf2e',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.264645] env[69232]: INFO networking_nsxv3.common.synchronization [req-ee30e4ec-01f0-4187-aded-ddcd7a768658 req-dfdd1d7b-de6e-489c-8264-940b89b394c1 service nova] Enqueued Resource ID: 453650db-0c42-4224-8f26-d113b3aaa020 with Priority: HIGHEST for action security_group_rules [ 692.264948] env[69232]: INFO networking_nsxv3.common.synchronization [req-ee30e4ec-01f0-4187-aded-ddcd7a768658 req-dfdd1d7b-de6e-489c-8264-940b89b394c1 service nova] Enqueued Resource ID: 453650db-0c42-4224-8f26-d113b3aaa020 with Priority: HIGHEST for action security_group_members [ 692.265034] env[69232]: INFO networking_nsxv3.common.synchronization [req-ee30e4ec-01f0-4187-aded-ddcd7a768658 req-dfdd1d7b-de6e-489c-8264-940b89b394c1 service nova] Enqueued Resource ID: e16f0ce7-c502-4746-b060-afc170eacd9d with Priority: HIGHEST for action port [ 692.265681] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 453650db-0c42-4224-8f26-d113b3aaa020 with Priority: HIGHEST for action security_group_rules [ 692.266369] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 453650db-0c42-4224-8f26-d113b3aaa020 with Priority: HIGHEST for action security_group_members [ 692.266369] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e16f0ce7-c502-4746-b060-afc170eacd9d with Priority: HIGHEST for action port [ 692.266970] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-453650db-0c42-4224-8f26-d113b3aaa020 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.267184] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-453650db-0c42-4224-8f26-d113b3aaa020" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.267475] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-453650db-0c42-4224-8f26-d113b3aaa020" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.268061] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-453650db-0c42-4224-8f26-d113b3aaa020" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.268061] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('453650db-0c42-4224-8f26-d113b3aaa020',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.269218] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-453650db-0c42-4224-8f26-d113b3aaa020 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.269415] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-453650db-0c42-4224-8f26-d113b3aaa020" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.269599] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-453650db-0c42-4224-8f26-d113b3aaa020" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.269789] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-453650db-0c42-4224-8f26-d113b3aaa020" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.270029] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.270704] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.270704] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.270842] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.271391] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.271391] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('453650db-0c42-4224-8f26-d113b3aaa020',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.273369] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-e16f0ce7-c502-4746-b060-afc170eacd9d taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.273686] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e16f0ce7-c502-4746-b060-afc170eacd9d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.273686] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e16f0ce7-c502-4746-b060-afc170eacd9d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.273882] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e16f0ce7-c502-4746-b060-afc170eacd9d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.273987] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e16f0ce7-c502-4746-b060-afc170eacd9d',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.602231] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 04c8afd4-5b6b-40d6-827e-7916015a1e43 in Status: SUCCESS [ 692.602702] env[69232]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 04c8afd4-5b6b-40d6-827e-7916015a1e43 deletion is rescheduled due to dependency. [ 692.602702] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04c8afd4-5b6b-40d6-827e-7916015a1e43" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.633043] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.633043] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.633043] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.633043] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.633043] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.633043] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.633043] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.633043] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.633043] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.633043] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.633043] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 96a06bfd-a7ad-4644-89c3-3168aa1fdf2e already deleted. [ 692.633043] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-96a06bfd-a7ad-4644-89c3-3168aa1fdf2e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.781027] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-453650db-0c42-4224-8f26-d113b3aaa020 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.781027] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-453650db-0c42-4224-8f26-d113b3aaa020" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.781027] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('453650db-0c42-4224-8f26-d113b3aaa020',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.781027] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e16f0ce7-c502-4746-b060-afc170eacd9d with status ACTIVE [ 692.781027] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.781027] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.781027] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.781027] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.781027] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.781027] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.781027] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.781027] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.781027] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.781027] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.787913] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.787913] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.787913] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.787913] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.787913] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.787913] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e16f0ce7-c502-4746-b060-afc170eacd9d is going to be updated. [ 692.811874] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.811874] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.812839] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.812839] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.812839] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.813270] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e16f0ce7-c502-4746-b060-afc170eacd9d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.966121] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f75b07e5-04f2-4dc3-80ad-ba8105cb4c82 in Status: SUCCESS [ 692.966348] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f75b07e5-04f2-4dc3-80ad-ba8105cb4c82" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.966525] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f75b07e5-04f2-4dc3-80ad-ba8105cb4c82" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.966749] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f75b07e5-04f2-4dc3-80ad-ba8105cb4c82" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.966943] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.970021] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.970021] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.970021] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.970021] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.970021] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f75b07e5-04f2-4dc3-80ad-ba8105cb4c82" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.970021] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f75b07e5-04f2-4dc3-80ad-ba8105cb4c82',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.983694] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock network-225 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.984000] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "network-225" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.984172] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "network-225" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.984413] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "network-225" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.984698] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.986324] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.986451] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.986784] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.986862] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.987580] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 692.987764] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] NeedRegenerationException {{(pid=69232) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 692.987953] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] no value, waiting for create lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 692.988089] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] value creation lock acquired {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 692.989619] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 692.990314] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Calling creation function for not-yet-present value {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 692.990522] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 693.018144] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 693.018327] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=69232) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 693.018465] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Released creation lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 693.018673] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "network-225" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.019024] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock port-0afdbc14-d89c-463d-92b7-fbbaaf5a49ed taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.019205] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "port-0afdbc14-d89c-463d-92b7-fbbaaf5a49ed" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.019354] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "port-0afdbc14-d89c-463d-92b7-fbbaaf5a49ed" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.019681] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "port-0afdbc14-d89c-463d-92b7-fbbaaf5a49ed" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.019817] env[69232]: DEBUG networking_nsxv3.api.rpc [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0afdbc14-d89c-463d-92b7-fbbaaf5a49ed',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.154736] env[69232]: INFO networking_nsxv3.common.synchronization [req-327c0349-d770-42a4-b500-594eaeed2825 req-0874acbb-6c3b-4dde-b3fa-e2e92a17c88a tempest-ServerDiskConfigTestJSON-1562148127 tempest-ServerDiskConfigTestJSON-1562148127-project-member] Enqueued Resource ID: 5a45a455-673b-417d-b2f6-be9352c2077e with Priority: HIGHEST for action security_group_members [ 693.155346] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a45a455-673b-417d-b2f6-be9352c2077e with Priority: HIGHEST for action security_group_members [ 693.155887] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a45a455-673b-417d-b2f6-be9352c2077e taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.156050] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a45a455-673b-417d-b2f6-be9352c2077e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.157678] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a45a455-673b-417d-b2f6-be9352c2077e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.157879] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a45a455-673b-417d-b2f6-be9352c2077e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.158125] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.158228] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.158296] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.158434] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.158525] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.158625] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5a45a455-673b-417d-b2f6-be9352c2077e',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.287782] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('453650db-0c42-4224-8f26-d113b3aaa020',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.479385] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-f75b07e5-04f2-4dc3-80ad-ba8105cb4c82 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.479385] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f75b07e5-04f2-4dc3-80ad-ba8105cb4c82" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.479742] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f75b07e5-04f2-4dc3-80ad-ba8105cb4c82" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.479742] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f75b07e5-04f2-4dc3-80ad-ba8105cb4c82" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.480665] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.480665] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.480665] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.480665] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.480665] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.480665] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f75b07e5-04f2-4dc3-80ad-ba8105cb4c82" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.480665] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-f75b07e5-04f2-4dc3-80ad-ba8105cb4c82 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.480665] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f75b07e5-04f2-4dc3-80ad-ba8105cb4c82" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.480665] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f75b07e5-04f2-4dc3-80ad-ba8105cb4c82" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.481507] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f75b07e5-04f2-4dc3-80ad-ba8105cb4c82" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.481507] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.481507] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.481507] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.481507] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.481507] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.481507] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f75b07e5-04f2-4dc3-80ad-ba8105cb4c82" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.481507] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f75b07e5-04f2-4dc3-80ad-ba8105cb4c82',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.529048] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.529048] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.529048] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.529048] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.529048] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.529048] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Segment Port 0afdbc14-d89c-463d-92b7-fbbaaf5a49ed not found, creating... [ 693.529048] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.529048] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.529048] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.529048] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.529048] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.530321] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.530321] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.530321] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.530321] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.530708] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.530996] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Resource: SegmentPort with ID: 0afdbc14-d89c-463d-92b7-fbbaaf5a49ed is going to be created. [ 693.566252] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.566252] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.566252] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.566252] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.566252] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.566252] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "port-0afdbc14-d89c-463d-92b7-fbbaaf5a49ed" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.664027] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.664027] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.664027] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.664027] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.664027] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.664027] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.664027] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.664027] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.664027] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.664027] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.664027] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5a45a455-673b-417d-b2f6-be9352c2077e is going to be updated. [ 693.665650] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5435d71f-3832-4f11-be57-bef3011dd7b7 in Status: SUCCESS [ 693.665868] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5435d71f-3832-4f11-be57-bef3011dd7b7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.707764] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.708116] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.708211] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.708448] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.708682] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.721110] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a45a455-673b-417d-b2f6-be9352c2077e in Status: IN_PROGRESS for 2s [ 693.795033] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.795033] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.795033] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.795033] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.795033] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.795033] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 453650db-0c42-4224-8f26-d113b3aaa020 is going to be created. [ 693.825295] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.825295] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.825295] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.825295] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.825295] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.838539] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 453650db-0c42-4224-8f26-d113b3aaa020 in Status: UNINITIALIZED for 2s [ 693.987546] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f75b07e5-04f2-4dc3-80ad-ba8105cb4c82: rpc.has_security_group_logging(os_id): False [ 694.012921] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.013097] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.013175] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.013386] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.013493] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.013701] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.013797] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.013865] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.014039] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.014120] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.014299] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.014396] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.014464] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.014600] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.014677] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.014887] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.016233] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.016538] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.016701] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.016851] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.016929] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f75b07e5-04f2-4dc3-80ad-ba8105cb4c82 is going to be updated. [ 694.103766] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.103935] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.104079] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.104219] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.104445] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.144708] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f75b07e5-04f2-4dc3-80ad-ba8105cb4c82 in Status: IN_PROGRESS for 2s [ 694.384903] env[69232]: INFO networking_nsxv3.common.synchronization [req-75944ff2-2c1c-4408-b3e9-4169b9db67c6 req-4727ba8c-1a40-4351-ae91-786a4bde64df service nova] Enqueued Resource ID: 96a06bfd-a7ad-4644-89c3-3168aa1fdf2e with Priority: HIGHEST for action security_group_rules [ 694.385127] env[69232]: INFO networking_nsxv3.common.synchronization [req-75944ff2-2c1c-4408-b3e9-4169b9db67c6 req-4727ba8c-1a40-4351-ae91-786a4bde64df service nova] Enqueued Resource ID: 96a06bfd-a7ad-4644-89c3-3168aa1fdf2e with Priority: HIGHEST for action security_group_members [ 694.385464] env[69232]: INFO networking_nsxv3.common.synchronization [req-75944ff2-2c1c-4408-b3e9-4169b9db67c6 req-4727ba8c-1a40-4351-ae91-786a4bde64df service nova] Enqueued Resource ID: 0afdbc14-d89c-463d-92b7-fbbaaf5a49ed with Priority: HIGHEST for action port [ 694.385995] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 96a06bfd-a7ad-4644-89c3-3168aa1fdf2e with Priority: HIGHEST for action security_group_rules [ 694.386201] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 96a06bfd-a7ad-4644-89c3-3168aa1fdf2e with Priority: HIGHEST for action security_group_members [ 694.386364] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0afdbc14-d89c-463d-92b7-fbbaaf5a49ed with Priority: HIGHEST for action port [ 694.386710] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-96a06bfd-a7ad-4644-89c3-3168aa1fdf2e taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.386932] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-96a06bfd-a7ad-4644-89c3-3168aa1fdf2e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.386932] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-96a06bfd-a7ad-4644-89c3-3168aa1fdf2e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.387325] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-96a06bfd-a7ad-4644-89c3-3168aa1fdf2e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.387476] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('96a06bfd-a7ad-4644-89c3-3168aa1fdf2e',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.388535] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-96a06bfd-a7ad-4644-89c3-3168aa1fdf2e taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.388679] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-96a06bfd-a7ad-4644-89c3-3168aa1fdf2e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.388776] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-96a06bfd-a7ad-4644-89c3-3168aa1fdf2e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.389097] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-96a06bfd-a7ad-4644-89c3-3168aa1fdf2e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.389259] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.389420] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.389529] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.389719] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.389890] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.389968] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('96a06bfd-a7ad-4644-89c3-3168aa1fdf2e',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.394205] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-0afdbc14-d89c-463d-92b7-fbbaaf5a49ed taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.394380] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0afdbc14-d89c-463d-92b7-fbbaaf5a49ed" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.394482] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0afdbc14-d89c-463d-92b7-fbbaaf5a49ed" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.394698] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0afdbc14-d89c-463d-92b7-fbbaaf5a49ed" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.394814] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0afdbc14-d89c-463d-92b7-fbbaaf5a49ed',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.900246] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-96a06bfd-a7ad-4644-89c3-3168aa1fdf2e taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.900605] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-96a06bfd-a7ad-4644-89c3-3168aa1fdf2e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.901026] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('96a06bfd-a7ad-4644-89c3-3168aa1fdf2e',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.907912] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0afdbc14-d89c-463d-92b7-fbbaaf5a49ed with status ACTIVE [ 694.908205] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.908411] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.908519] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.908822] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.908961] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.911370] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.911612] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.912540] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.912976] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.913085] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.914462] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.914462] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.914462] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.914708] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.914890] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.915417] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0afdbc14-d89c-463d-92b7-fbbaaf5a49ed is going to be updated. [ 694.945909] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.945909] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.945909] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.945909] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.945909] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.945909] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0afdbc14-d89c-463d-92b7-fbbaaf5a49ed" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.420447] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('96a06bfd-a7ad-4644-89c3-3168aa1fdf2e',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.565264] env[69232]: INFO networking_nsxv3.common.synchronization [req-857eb405-5f6f-4556-b53b-7da03ec50fe4 req-9e3ced2b-46a0-4356-82e1-9845aebc2fd6 tempest-ServerDiagnosticsNegativeTest-1135522305 tempest-ServerDiagnosticsNegativeTest-1135522305-project-member] Enqueued Resource ID: 51567675-5d85-4a23-9a2e-1353be4f6ecc with Priority: HIGHEST for action security_group_members [ 695.565922] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 51567675-5d85-4a23-9a2e-1353be4f6ecc with Priority: HIGHEST for action security_group_members [ 695.568365] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-51567675-5d85-4a23-9a2e-1353be4f6ecc taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.568523] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-51567675-5d85-4a23-9a2e-1353be4f6ecc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.568774] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-51567675-5d85-4a23-9a2e-1353be4f6ecc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.568853] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-51567675-5d85-4a23-9a2e-1353be4f6ecc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.569012] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.569139] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.569208] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.569402] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.569488] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.569611] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('51567675-5d85-4a23-9a2e-1353be4f6ecc',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.733418] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a45a455-673b-417d-b2f6-be9352c2077e in Status: SUCCESS [ 695.733418] env[69232]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5a45a455-673b-417d-b2f6-be9352c2077e deletion is rescheduled due to dependency. [ 695.733418] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a45a455-673b-417d-b2f6-be9352c2077e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.857034] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 453650db-0c42-4224-8f26-d113b3aaa020 in Status: SUCCESS [ 695.857034] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-453650db-0c42-4224-8f26-d113b3aaa020" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.857034] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-453650db-0c42-4224-8f26-d113b3aaa020" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.857034] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-453650db-0c42-4224-8f26-d113b3aaa020" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.857034] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.857034] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.857034] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.857034] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.857034] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.857034] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-453650db-0c42-4224-8f26-d113b3aaa020" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.857034] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('453650db-0c42-4224-8f26-d113b3aaa020',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.897521] env[69232]: INFO networking_nsxv3.common.synchronization [None req-c32a8f31-17c6-48a0-a90b-93f3fbd6ae18 None None] Enqueued Resource ID: 789d1d8c-2f66-4ffa-a9b1-bbcfd7e5eeec with Priority: HIGHEST for action port [ 695.898494] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 789d1d8c-2f66-4ffa-a9b1-bbcfd7e5eeec with Priority: HIGHEST for action port [ 695.898854] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-789d1d8c-2f66-4ffa-a9b1-bbcfd7e5eeec taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.899012] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-789d1d8c-2f66-4ffa-a9b1-bbcfd7e5eeec" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.899088] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-789d1d8c-2f66-4ffa-a9b1-bbcfd7e5eeec" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.899425] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-789d1d8c-2f66-4ffa-a9b1-bbcfd7e5eeec" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.899593] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('789d1d8c-2f66-4ffa-a9b1-bbcfd7e5eeec',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.924781] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.925331] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.925331] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.925331] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.925478] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.925575] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 96a06bfd-a7ad-4644-89c3-3168aa1fdf2e is going to be created. [ 695.956430] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.957053] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.957279] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.957672] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.957988] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.971597] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 96a06bfd-a7ad-4644-89c3-3168aa1fdf2e in Status: UNINITIALIZED for 2s [ 696.077784] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.077784] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.077784] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.077784] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.077784] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.077784] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.077784] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.077784] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.077784] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.077784] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.077784] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 51567675-5d85-4a23-9a2e-1353be4f6ecc is going to be updated. [ 696.111388] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.111625] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.111625] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.112422] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.112422] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.121354] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 51567675-5d85-4a23-9a2e-1353be4f6ecc in Status: IN_PROGRESS for 2s [ 696.160987] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f75b07e5-04f2-4dc3-80ad-ba8105cb4c82 in Status: SUCCESS [ 696.160987] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f75b07e5-04f2-4dc3-80ad-ba8105cb4c82" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.361322] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('453650db-0c42-4224-8f26-d113b3aaa020',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.404350] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 789d1d8c-2f66-4ffa-a9b1-bbcfd7e5eeec [ 696.404937] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.404937] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.405181] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.405227] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.405290] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.405399] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:789d1d8c-2f66-4ffa-a9b1-bbcfd7e5eeec already deleted. [ 696.405474] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-789d1d8c-2f66-4ffa-a9b1-bbcfd7e5eeec" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.869020] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 453650db-0c42-4224-8f26-d113b3aaa020: rpc.has_security_group_logging(os_id): False [ 696.869020] env[69232]: INFO networking_nsxv3.common.synchronization [None req-09215286-0369-4419-833a-c1ef4cef7921 None None] Enqueued Resource ID: 999a903f-d720-4bae-96cc-0b6bb23db582 with Priority: HIGHEST for action port [ 696.869020] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 999a903f-d720-4bae-96cc-0b6bb23db582 with Priority: HIGHEST for action port [ 696.869795] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-999a903f-d720-4bae-96cc-0b6bb23db582 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.869929] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-999a903f-d720-4bae-96cc-0b6bb23db582" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.869979] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-999a903f-d720-4bae-96cc-0b6bb23db582" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.870246] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-999a903f-d720-4bae-96cc-0b6bb23db582" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.870331] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('999a903f-d720-4bae-96cc-0b6bb23db582',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.888413] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.888873] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.888982] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.889212] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.889366] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.890540] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.890745] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.890848] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.891056] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.891160] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.891236] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 453650db-0c42-4224-8f26-d113b3aaa020 is going to be created. [ 696.972254] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.975022] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.975022] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.975022] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.975022] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.990513] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 453650db-0c42-4224-8f26-d113b3aaa020 in Status: IN_PROGRESS for 2s [ 697.373273] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 999a903f-d720-4bae-96cc-0b6bb23db582 [ 697.373541] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.373718] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.373849] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.374355] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.374460] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.374568] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:999a903f-d720-4bae-96cc-0b6bb23db582 already deleted. [ 697.374652] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-999a903f-d720-4bae-96cc-0b6bb23db582" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.806473] env[69232]: INFO networking_nsxv3.common.synchronization [None req-25012011-22d1-4146-8419-0bdf49208629 None None] Enqueued Resource ID: 79386ae0-ca88-4977-adb3-3f91bf1eeb6d with Priority: HIGHEST for action port [ 697.806920] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 79386ae0-ca88-4977-adb3-3f91bf1eeb6d with Priority: HIGHEST for action port [ 697.807544] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-79386ae0-ca88-4977-adb3-3f91bf1eeb6d taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.807684] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-79386ae0-ca88-4977-adb3-3f91bf1eeb6d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.807763] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-79386ae0-ca88-4977-adb3-3f91bf1eeb6d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.807992] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-79386ae0-ca88-4977-adb3-3f91bf1eeb6d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.809210] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('79386ae0-ca88-4977-adb3-3f91bf1eeb6d',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.982435] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 96a06bfd-a7ad-4644-89c3-3168aa1fdf2e in Status: SUCCESS [ 697.982730] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-96a06bfd-a7ad-4644-89c3-3168aa1fdf2e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.982833] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-96a06bfd-a7ad-4644-89c3-3168aa1fdf2e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.983060] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-96a06bfd-a7ad-4644-89c3-3168aa1fdf2e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.983248] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.983364] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.983426] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.983586] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.983663] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.983742] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-96a06bfd-a7ad-4644-89c3-3168aa1fdf2e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.983841] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('96a06bfd-a7ad-4644-89c3-3168aa1fdf2e',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.135510] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 51567675-5d85-4a23-9a2e-1353be4f6ecc in Status: SUCCESS [ 698.135726] env[69232]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 51567675-5d85-4a23-9a2e-1353be4f6ecc deletion is rescheduled due to dependency. [ 698.135844] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-51567675-5d85-4a23-9a2e-1353be4f6ecc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.311685] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 79386ae0-ca88-4977-adb3-3f91bf1eeb6d [ 698.311937] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.312821] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.312821] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.312821] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.312821] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.312821] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:79386ae0-ca88-4977-adb3-3f91bf1eeb6d already deleted. [ 698.312821] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-79386ae0-ca88-4977-adb3-3f91bf1eeb6d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.487027] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-96a06bfd-a7ad-4644-89c3-3168aa1fdf2e taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.487343] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-96a06bfd-a7ad-4644-89c3-3168aa1fdf2e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.487499] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-96a06bfd-a7ad-4644-89c3-3168aa1fdf2e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.487814] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-96a06bfd-a7ad-4644-89c3-3168aa1fdf2e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.488105] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.488279] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.488394] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.489032] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.489032] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.489032] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-96a06bfd-a7ad-4644-89c3-3168aa1fdf2e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.489032] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-96a06bfd-a7ad-4644-89c3-3168aa1fdf2e taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.489557] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-96a06bfd-a7ad-4644-89c3-3168aa1fdf2e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.489557] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-96a06bfd-a7ad-4644-89c3-3168aa1fdf2e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.489557] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-96a06bfd-a7ad-4644-89c3-3168aa1fdf2e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.489557] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.489708] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.489708] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.489981] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.490110] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.490231] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-96a06bfd-a7ad-4644-89c3-3168aa1fdf2e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.490372] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('96a06bfd-a7ad-4644-89c3-3168aa1fdf2e',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.736015] env[69232]: INFO networking_nsxv3.common.synchronization [req-88573135-2912-4d7b-8350-f2899de08b46 req-58da1bcc-1eda-41e5-8ea0-eb7cd1cf655a tempest-ServersTestBootFromVolume-980609594 tempest-ServersTestBootFromVolume-980609594-project-member] Enqueued Resource ID: 45780cba-cd94-4a19-b7a8-aa324fdcb9c5 with Priority: HIGHEST for action security_group_members [ 698.736360] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45780cba-cd94-4a19-b7a8-aa324fdcb9c5 with Priority: HIGHEST for action security_group_members [ 698.736776] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-45780cba-cd94-4a19-b7a8-aa324fdcb9c5 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.736925] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45780cba-cd94-4a19-b7a8-aa324fdcb9c5" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.736925] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45780cba-cd94-4a19-b7a8-aa324fdcb9c5" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.737162] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45780cba-cd94-4a19-b7a8-aa324fdcb9c5" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.737349] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.737914] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.737914] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.737914] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.737914] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.737914] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('45780cba-cd94-4a19-b7a8-aa324fdcb9c5',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.992265] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 96a06bfd-a7ad-4644-89c3-3168aa1fdf2e: rpc.has_security_group_logging(os_id): False [ 699.013252] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 453650db-0c42-4224-8f26-d113b3aaa020 in Status: SUCCESS [ 699.013252] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-453650db-0c42-4224-8f26-d113b3aaa020" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.015974] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.017921] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.018098] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.018364] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.018451] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.018684] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.018785] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.018842] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.019022] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.019099] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.019327] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.019462] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.019505] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.020023] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.020023] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.020023] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.020287] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.020287] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.020779] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.020779] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.020779] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 96a06bfd-a7ad-4644-89c3-3168aa1fdf2e is going to be created. [ 699.101476] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.101476] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.101626] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.101812] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.102045] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.121128] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 96a06bfd-a7ad-4644-89c3-3168aa1fdf2e in Status: IN_PROGRESS for 2s [ 699.240898] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.241096] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.241159] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.241376] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.241468] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.241793] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.241883] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.241924] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.242108] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.242193] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.242282] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 45780cba-cd94-4a19-b7a8-aa324fdcb9c5 already deleted. [ 699.242364] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45780cba-cd94-4a19-b7a8-aa324fdcb9c5" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.517502] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock network-469 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.517702] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "network-469" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.517824] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "network-469" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.518198] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "network-469" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.518735] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.518825] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.518895] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.519624] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.519624] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.519624] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 699.521328] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] NeedRegenerationException {{(pid=69232) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 699.521724] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] no value, waiting for create lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 699.521874] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] value creation lock acquired {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 699.521930] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 699.522052] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Calling creation function for not-yet-present value {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 699.522201] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 699.544375] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 699.544871] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69232) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 699.544871] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Released creation lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 699.544871] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "network-469" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.545173] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock port-7c4f63a7-ed94-4760-ac79-9d4b558a0e62 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.546070] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "port-7c4f63a7-ed94-4760-ac79-9d4b558a0e62" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.546070] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "port-7c4f63a7-ed94-4760-ac79-9d4b558a0e62" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.546070] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "port-7c4f63a7-ed94-4760-ac79-9d4b558a0e62" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.546807] env[69232]: DEBUG networking_nsxv3.api.rpc [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7c4f63a7-ed94-4760-ac79-9d4b558a0e62',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.048644] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.049287] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.049505] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.049813] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.049966] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.050180] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Segment Port 7c4f63a7-ed94-4760-ac79-9d4b558a0e62 not found, creating... [ 700.050579] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.050770] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.050903] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.051164] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.053466] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.053873] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.054078] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.054204] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.054457] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.055205] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.055373] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Resource: SegmentPort with ID: 7c4f63a7-ed94-4760-ac79-9d4b558a0e62 is going to be created. [ 700.068804] env[69232]: INFO networking_nsxv3.common.synchronization [None req-18318d56-f922-4cc4-95ea-64bd759cfd0c None None] Enqueued Resource ID: de0e3290-82b7-446c-8198-164a210afd39 with Priority: HIGHEST for action port [ 700.071036] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de0e3290-82b7-446c-8198-164a210afd39 with Priority: HIGHEST for action port [ 700.071036] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-de0e3290-82b7-446c-8198-164a210afd39 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.071036] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-de0e3290-82b7-446c-8198-164a210afd39" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.071036] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-de0e3290-82b7-446c-8198-164a210afd39" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.071036] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-de0e3290-82b7-446c-8198-164a210afd39" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.071036] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('de0e3290-82b7-446c-8198-164a210afd39',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.085359] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.085573] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.087885] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.087885] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.087885] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.087885] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "port-7c4f63a7-ed94-4760-ac79-9d4b558a0e62" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.433483] env[69232]: INFO networking_nsxv3.common.synchronization [None req-2dfe235e-1c6f-4a72-af50-49c74320a0a4 None None] Enqueued Resource ID: 47cc9702-e934-4fb8-a4e3-3e35dd73925d with Priority: HIGHEST for action port [ 700.433483] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47cc9702-e934-4fb8-a4e3-3e35dd73925d with Priority: HIGHEST for action port [ 700.436029] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-47cc9702-e934-4fb8-a4e3-3e35dd73925d taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.436029] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-47cc9702-e934-4fb8-a4e3-3e35dd73925d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.436029] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-47cc9702-e934-4fb8-a4e3-3e35dd73925d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.436029] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-47cc9702-e934-4fb8-a4e3-3e35dd73925d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.436029] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('47cc9702-e934-4fb8-a4e3-3e35dd73925d',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.517866] env[69232]: INFO networking_nsxv3.common.synchronization [None req-51f69240-31e9-4c41-8379-a4b613c86ad4 tempest-MigrationsAdminTest-606964981 tempest-MigrationsAdminTest-606964981-project-member] Enqueued Resource ID: b4c74b47-225e-472f-a161-151aaab0cf5e with Priority: HIGHEST for action security_group_rules [ 700.518471] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4c74b47-225e-472f-a161-151aaab0cf5e with Priority: HIGHEST for action security_group_rules [ 700.518935] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b4c74b47-225e-472f-a161-151aaab0cf5e taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.519090] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b4c74b47-225e-472f-a161-151aaab0cf5e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.519155] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b4c74b47-225e-472f-a161-151aaab0cf5e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.519455] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b4c74b47-225e-472f-a161-151aaab0cf5e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.519540] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b4c74b47-225e-472f-a161-151aaab0cf5e',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.574244] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port de0e3290-82b7-446c-8198-164a210afd39 [ 700.574244] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.574244] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.574244] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.574244] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.574244] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.574244] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:de0e3290-82b7-446c-8198-164a210afd39 already deleted. [ 700.574244] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-de0e3290-82b7-446c-8198-164a210afd39" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.635720] env[69232]: INFO networking_nsxv3.common.synchronization [None req-98b11402-db50-463f-b975-19520136e763 tempest-MigrationsAdminTest-606964981 tempest-MigrationsAdminTest-606964981-project-member] Enqueued Resource ID: b4c74b47-225e-472f-a161-151aaab0cf5e with Priority: HIGHEST for action security_group_rules [ 700.635720] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4c74b47-225e-472f-a161-151aaab0cf5e with Priority: HIGHEST for action security_group_rules [ 700.635720] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b4c74b47-225e-472f-a161-151aaab0cf5e taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.635720] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b4c74b47-225e-472f-a161-151aaab0cf5e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.938462] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 47cc9702-e934-4fb8-a4e3-3e35dd73925d [ 700.938800] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.938996] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.939818] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.939818] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.939818] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.939818] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:47cc9702-e934-4fb8-a4e3-3e35dd73925d already deleted. [ 700.939818] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-47cc9702-e934-4fb8-a4e3-3e35dd73925d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.042234] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.042416] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.042532] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.042704] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.042792] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.042886] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b4c74b47-225e-472f-a161-151aaab0cf5e already deleted. [ 701.042968] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b4c74b47-225e-472f-a161-151aaab0cf5e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.043145] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b4c74b47-225e-472f-a161-151aaab0cf5e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.043305] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b4c74b47-225e-472f-a161-151aaab0cf5e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.043389] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b4c74b47-225e-472f-a161-151aaab0cf5e',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.139568] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 96a06bfd-a7ad-4644-89c3-3168aa1fdf2e in Status: SUCCESS [ 701.139853] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-96a06bfd-a7ad-4644-89c3-3168aa1fdf2e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.372819] env[69232]: INFO networking_nsxv3.common.synchronization [None req-d9559047-3990-4362-aa39-673860683d2c None None] Enqueued Resource ID: a856151a-cae3-409b-9f69-b2c009a64b87 with Priority: HIGHEST for action port [ 701.374595] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a856151a-cae3-409b-9f69-b2c009a64b87 with Priority: HIGHEST for action port [ 701.375494] env[69232]: INFO networking_nsxv3.common.synchronization [req-88573135-2912-4d7b-8350-f2899de08b46 req-28656646-af72-48c7-92ff-da8163a11555 service nova] Enqueued Resource ID: 45780cba-cd94-4a19-b7a8-aa324fdcb9c5 with Priority: HIGHEST for action security_group_rules [ 701.375710] env[69232]: INFO networking_nsxv3.common.synchronization [req-88573135-2912-4d7b-8350-f2899de08b46 req-28656646-af72-48c7-92ff-da8163a11555 service nova] Enqueued Resource ID: 45780cba-cd94-4a19-b7a8-aa324fdcb9c5 with Priority: HIGHEST for action security_group_members [ 701.375870] env[69232]: INFO networking_nsxv3.common.synchronization [req-88573135-2912-4d7b-8350-f2899de08b46 req-28656646-af72-48c7-92ff-da8163a11555 service nova] Enqueued Resource ID: 7c4f63a7-ed94-4760-ac79-9d4b558a0e62 with Priority: HIGHEST for action port [ 701.376290] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-a856151a-cae3-409b-9f69-b2c009a64b87 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.376455] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a856151a-cae3-409b-9f69-b2c009a64b87" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.376506] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a856151a-cae3-409b-9f69-b2c009a64b87" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.377926] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a856151a-cae3-409b-9f69-b2c009a64b87" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.377926] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a856151a-cae3-409b-9f69-b2c009a64b87',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.378127] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45780cba-cd94-4a19-b7a8-aa324fdcb9c5 with Priority: HIGHEST for action security_group_rules [ 701.378297] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45780cba-cd94-4a19-b7a8-aa324fdcb9c5 with Priority: HIGHEST for action security_group_members [ 701.378346] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c4f63a7-ed94-4760-ac79-9d4b558a0e62 with Priority: HIGHEST for action port [ 701.378874] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-45780cba-cd94-4a19-b7a8-aa324fdcb9c5 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.379039] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-45780cba-cd94-4a19-b7a8-aa324fdcb9c5" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.379153] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-45780cba-cd94-4a19-b7a8-aa324fdcb9c5" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.379443] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-45780cba-cd94-4a19-b7a8-aa324fdcb9c5" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.379566] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('45780cba-cd94-4a19-b7a8-aa324fdcb9c5',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.380811] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-45780cba-cd94-4a19-b7a8-aa324fdcb9c5 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.380811] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45780cba-cd94-4a19-b7a8-aa324fdcb9c5" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.381019] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45780cba-cd94-4a19-b7a8-aa324fdcb9c5" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.381122] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45780cba-cd94-4a19-b7a8-aa324fdcb9c5" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.381592] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.381768] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.382327] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.382327] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.382327] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.382327] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('45780cba-cd94-4a19-b7a8-aa324fdcb9c5',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.383287] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-7c4f63a7-ed94-4760-ac79-9d4b558a0e62 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.383420] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7c4f63a7-ed94-4760-ac79-9d4b558a0e62" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.383488] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7c4f63a7-ed94-4760-ac79-9d4b558a0e62" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.383673] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7c4f63a7-ed94-4760-ac79-9d4b558a0e62" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.383747] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7c4f63a7-ed94-4760-ac79-9d4b558a0e62',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.552250] env[69232]: INFO networking_nsxv3.common.synchronization [req-e0a33281-f839-4c09-aa3a-2a371fcd0fbe req-73d3f5b3-3019-432b-ae7e-f38c5378abb0 tempest-ServerTagsTestJSON-1644553538 tempest-ServerTagsTestJSON-1644553538-project-member] Enqueued Resource ID: 131f51ef-2833-4453-914e-c87497d66ff6 with Priority: HIGHEST for action security_group_members [ 701.552250] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 131f51ef-2833-4453-914e-c87497d66ff6 with Priority: HIGHEST for action security_group_members [ 701.552250] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-131f51ef-2833-4453-914e-c87497d66ff6 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.552250] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-131f51ef-2833-4453-914e-c87497d66ff6" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.552250] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-131f51ef-2833-4453-914e-c87497d66ff6" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.552250] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-131f51ef-2833-4453-914e-c87497d66ff6" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.552250] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.552250] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.552984] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.553242] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.553395] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.553542] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('131f51ef-2833-4453-914e-c87497d66ff6',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.589739] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.590433] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.590433] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.590433] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.590433] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.590433] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b4c74b47-225e-472f-a161-151aaab0cf5e already deleted. [ 701.593437] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b4c74b47-225e-472f-a161-151aaab0cf5e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.698915] env[69232]: INFO networking_nsxv3.common.synchronization [None req-eda6867e-8994-46ab-b33e-4395082027cf tempest-ServersTestManualDisk-382677829 tempest-ServersTestManualDisk-382677829-project-member] Enqueued Resource ID: 24c49db3-d2db-437b-976f-e83851ddd42c with Priority: HIGHEST for action security_group_rules [ 701.698915] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24c49db3-d2db-437b-976f-e83851ddd42c with Priority: HIGHEST for action security_group_rules [ 701.699110] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-24c49db3-d2db-437b-976f-e83851ddd42c taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.699255] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-24c49db3-d2db-437b-976f-e83851ddd42c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.699383] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-24c49db3-d2db-437b-976f-e83851ddd42c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.699633] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-24c49db3-d2db-437b-976f-e83851ddd42c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.700078] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('24c49db3-d2db-437b-976f-e83851ddd42c',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.879502] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a856151a-cae3-409b-9f69-b2c009a64b87 [ 701.879949] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.880116] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.880261] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.880546] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.880705] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.881352] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a856151a-cae3-409b-9f69-b2c009a64b87 already deleted. [ 701.881352] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a856151a-cae3-409b-9f69-b2c009a64b87" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.885395] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-45780cba-cd94-4a19-b7a8-aa324fdcb9c5 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.885511] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45780cba-cd94-4a19-b7a8-aa324fdcb9c5" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.885762] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('45780cba-cd94-4a19-b7a8-aa324fdcb9c5',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.887962] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7c4f63a7-ed94-4760-ac79-9d4b558a0e62 with status ACTIVE [ 701.888076] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.888206] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.888289] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.888542] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.888634] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.888816] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.888912] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.888972] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.889164] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.889242] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.889459] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.889577] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.889657] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.889802] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.889878] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.890021] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7c4f63a7-ed94-4760-ac79-9d4b558a0e62 is going to be updated. [ 701.914261] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.914261] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.914261] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.914261] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.914261] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.914538] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7c4f63a7-ed94-4760-ac79-9d4b558a0e62" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.999836] env[69232]: INFO networking_nsxv3.common.synchronization [None req-768f2158-3401-4bf5-84a1-c91aaa821c2a tempest-ServersTestManualDisk-382677829 tempest-ServersTestManualDisk-382677829-project-member] Enqueued Resource ID: 24c49db3-d2db-437b-976f-e83851ddd42c with Priority: HIGHEST for action security_group_rules [ 702.000408] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24c49db3-d2db-437b-976f-e83851ddd42c with Priority: HIGHEST for action security_group_rules [ 702.000714] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-24c49db3-d2db-437b-976f-e83851ddd42c taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.000831] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-24c49db3-d2db-437b-976f-e83851ddd42c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.057886] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.058513] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.061862] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.061862] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.061862] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.061862] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.061862] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.061862] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.061862] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.061862] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.061862] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 131f51ef-2833-4453-914e-c87497d66ff6 is going to be updated. [ 702.102803] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.103182] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.103361] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.103646] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.103947] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.118763] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 131f51ef-2833-4453-914e-c87497d66ff6 in Status: IN_PROGRESS for 2s [ 702.227242] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.227586] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.227586] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.227844] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.229110] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.229194] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 24c49db3-d2db-437b-976f-e83851ddd42c already deleted. [ 702.230428] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-24c49db3-d2db-437b-976f-e83851ddd42c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.230428] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-24c49db3-d2db-437b-976f-e83851ddd42c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.230428] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-24c49db3-d2db-437b-976f-e83851ddd42c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.230428] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('24c49db3-d2db-437b-976f-e83851ddd42c',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.392719] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('45780cba-cd94-4a19-b7a8-aa324fdcb9c5',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.762073] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.762250] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.762321] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.762534] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.762628] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.762725] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 24c49db3-d2db-437b-976f-e83851ddd42c already deleted. [ 702.762802] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-24c49db3-d2db-437b-976f-e83851ddd42c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.841072] env[69232]: INFO networking_nsxv3.common.synchronization [req-e82692b5-3027-4daa-888a-a009a8f3592d req-795b0571-e0ce-4f5d-a7b8-7c4873bb1ca6 tempest-ServerGroupTestJSON-1414402668 tempest-ServerGroupTestJSON-1414402668-project-member] Enqueued Resource ID: d0209331-de3e-477d-82f5-64fcd50f25cf with Priority: HIGHEST for action security_group_members [ 702.841719] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0209331-de3e-477d-82f5-64fcd50f25cf with Priority: HIGHEST for action security_group_members [ 702.842011] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0209331-de3e-477d-82f5-64fcd50f25cf taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.843047] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0209331-de3e-477d-82f5-64fcd50f25cf" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.843229] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0209331-de3e-477d-82f5-64fcd50f25cf" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.843637] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0209331-de3e-477d-82f5-64fcd50f25cf" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.843862] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.844041] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.844150] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.844349] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.844509] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.844686] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d0209331-de3e-477d-82f5-64fcd50f25cf',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.898937] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.898937] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.898937] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.898937] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.898937] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.898937] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 45780cba-cd94-4a19-b7a8-aa324fdcb9c5 is going to be created. [ 702.926971] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.927221] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.927375] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.927712] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.927927] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.939380] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 45780cba-cd94-4a19-b7a8-aa324fdcb9c5 in Status: UNINITIALIZED for 2s [ 703.182791] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock network-273 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.183270] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "network-273" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.183488] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "network-273" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.183988] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "network-273" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.184452] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.184710] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.184903] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.185295] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.185556] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.185902] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 703.186463] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] NeedRegenerationException {{(pid=69232) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 703.186724] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] no value, waiting for create lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 703.186964] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] value creation lock acquired {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 703.187198] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 703.187406] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Calling creation function for not-yet-present value {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 703.187798] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 703.217732] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 703.217989] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=69232) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 703.218190] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Released creation lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 703.218399] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "network-273" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.218757] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock port-40f4d7c0-c94a-45e8-b0ab-f1178b8edb07 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.218939] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "port-40f4d7c0-c94a-45e8-b0ab-f1178b8edb07" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.219082] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "port-40f4d7c0-c94a-45e8-b0ab-f1178b8edb07" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.219520] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "port-40f4d7c0-c94a-45e8-b0ab-f1178b8edb07" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.219667] env[69232]: DEBUG networking_nsxv3.api.rpc [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('40f4d7c0-c94a-45e8-b0ab-f1178b8edb07',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.347572] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.347921] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.347921] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.348051] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.348159] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.348359] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.348460] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.348523] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.348681] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.348755] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.348927] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d0209331-de3e-477d-82f5-64fcd50f25cf already deleted. [ 703.349028] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0209331-de3e-477d-82f5-64fcd50f25cf" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.724189] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.724436] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.724567] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.725243] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.725425] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.725626] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Segment Port 40f4d7c0-c94a-45e8-b0ab-f1178b8edb07 not found, creating... [ 703.725912] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.726083] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.726273] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.726425] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.726584] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.726870] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.727033] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.727166] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.727460] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.727623] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.727767] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Resource: SegmentPort with ID: 40f4d7c0-c94a-45e8-b0ab-f1178b8edb07 is going to be created. [ 703.749858] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.750084] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.750209] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.750629] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.750860] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.751106] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "port-40f4d7c0-c94a-45e8-b0ab-f1178b8edb07" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.131171] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 131f51ef-2833-4453-914e-c87497d66ff6 in Status: SUCCESS [ 704.131364] env[69232]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 131f51ef-2833-4453-914e-c87497d66ff6 deletion is rescheduled due to dependency. [ 704.131364] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-131f51ef-2833-4453-914e-c87497d66ff6" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.498121] env[69232]: INFO networking_nsxv3.common.synchronization [req-e82692b5-3027-4daa-888a-a009a8f3592d req-bf81e777-64ac-484f-9823-0da97605a025 service nova] Enqueued Resource ID: d0209331-de3e-477d-82f5-64fcd50f25cf with Priority: HIGHEST for action security_group_rules [ 704.498397] env[69232]: INFO networking_nsxv3.common.synchronization [req-e82692b5-3027-4daa-888a-a009a8f3592d req-bf81e777-64ac-484f-9823-0da97605a025 service nova] Enqueued Resource ID: d0209331-de3e-477d-82f5-64fcd50f25cf with Priority: HIGHEST for action security_group_members [ 704.498442] env[69232]: INFO networking_nsxv3.common.synchronization [req-e82692b5-3027-4daa-888a-a009a8f3592d req-bf81e777-64ac-484f-9823-0da97605a025 service nova] Enqueued Resource ID: 40f4d7c0-c94a-45e8-b0ab-f1178b8edb07 with Priority: HIGHEST for action port [ 704.498795] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0209331-de3e-477d-82f5-64fcd50f25cf with Priority: HIGHEST for action security_group_rules [ 704.498872] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0209331-de3e-477d-82f5-64fcd50f25cf with Priority: HIGHEST for action security_group_members [ 704.498964] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40f4d7c0-c94a-45e8-b0ab-f1178b8edb07 with Priority: HIGHEST for action port [ 704.499611] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d0209331-de3e-477d-82f5-64fcd50f25cf taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.499732] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d0209331-de3e-477d-82f5-64fcd50f25cf" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.499797] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d0209331-de3e-477d-82f5-64fcd50f25cf" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.504407] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d0209331-de3e-477d-82f5-64fcd50f25cf" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.504407] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d0209331-de3e-477d-82f5-64fcd50f25cf',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.504407] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0209331-de3e-477d-82f5-64fcd50f25cf taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.504407] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0209331-de3e-477d-82f5-64fcd50f25cf" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.504407] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0209331-de3e-477d-82f5-64fcd50f25cf" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.504695] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0209331-de3e-477d-82f5-64fcd50f25cf" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.505466] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.505466] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.505466] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.505466] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.505691] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.505823] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d0209331-de3e-477d-82f5-64fcd50f25cf',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.508209] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-40f4d7c0-c94a-45e8-b0ab-f1178b8edb07 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.508209] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-40f4d7c0-c94a-45e8-b0ab-f1178b8edb07" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.508209] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-40f4d7c0-c94a-45e8-b0ab-f1178b8edb07" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.509250] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-40f4d7c0-c94a-45e8-b0ab-f1178b8edb07" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.509413] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('40f4d7c0-c94a-45e8-b0ab-f1178b8edb07',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.762018] env[69232]: INFO networking_nsxv3.common.synchronization [req-4fd44208-343b-4966-83bc-c5a63cee7a06 req-bae62ae0-68dc-4c11-a536-458d3b61f030 tempest-ImagesTestJSON-1245210724 tempest-ImagesTestJSON-1245210724-project-member] Enqueued Resource ID: fb3494b9-4ce5-4744-a378-ecbcd5c2bec9 with Priority: HIGHEST for action security_group_members [ 704.762185] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb3494b9-4ce5-4744-a378-ecbcd5c2bec9 with Priority: HIGHEST for action security_group_members [ 704.762453] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.762573] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.763985] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.763985] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.763985] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.763985] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.763985] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.764219] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.764219] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.764219] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fb3494b9-4ce5-4744-a378-ecbcd5c2bec9',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.953605] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 45780cba-cd94-4a19-b7a8-aa324fdcb9c5 in Status: SUCCESS [ 704.953939] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45780cba-cd94-4a19-b7a8-aa324fdcb9c5" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.954209] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45780cba-cd94-4a19-b7a8-aa324fdcb9c5" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.954540] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45780cba-cd94-4a19-b7a8-aa324fdcb9c5" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.954850] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.955066] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.955204] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.955882] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.956011] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.956119] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45780cba-cd94-4a19-b7a8-aa324fdcb9c5" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.956218] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('45780cba-cd94-4a19-b7a8-aa324fdcb9c5',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.966341] env[69232]: INFO networking_nsxv3.common.synchronization [req-1252ca51-b348-469d-bc85-ac581814400b req-6ac1dbda-9187-46f0-acad-2e015429fa36 tempest-AttachInterfacesTestJSON-1442903876 tempest-AttachInterfacesTestJSON-1442903876-project-member] Enqueued Resource ID: 20ba03af-aba0-4fe6-af1e-ea103067fcbe with Priority: HIGHEST for action security_group_members [ 704.966959] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20ba03af-aba0-4fe6-af1e-ea103067fcbe with Priority: HIGHEST for action security_group_members [ 704.967281] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-20ba03af-aba0-4fe6-af1e-ea103067fcbe taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.967416] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-20ba03af-aba0-4fe6-af1e-ea103067fcbe" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.967768] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-20ba03af-aba0-4fe6-af1e-ea103067fcbe" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.968069] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-20ba03af-aba0-4fe6-af1e-ea103067fcbe" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.968241] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.968347] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.968417] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.968581] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.968675] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.968793] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('20ba03af-aba0-4fe6-af1e-ea103067fcbe',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.012777] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d0209331-de3e-477d-82f5-64fcd50f25cf',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.018026] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 40f4d7c0-c94a-45e8-b0ab-f1178b8edb07 with status ACTIVE [ 705.018026] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.018026] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.018026] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.018026] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.018026] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.018026] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.018026] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.018026] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.018026] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.018026] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.018026] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.018026] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.018026] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.018026] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.018860] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.018860] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 40f4d7c0-c94a-45e8-b0ab-f1178b8edb07 is going to be updated. [ 705.020331] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0209331-de3e-477d-82f5-64fcd50f25cf taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.020477] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0209331-de3e-477d-82f5-64fcd50f25cf" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.076785] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.077115] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.077254] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.077771] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.077874] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.078103] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-40f4d7c0-c94a-45e8-b0ab-f1178b8edb07" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.249314] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock network-674 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.249523] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "network-674" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.249581] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "network-674" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.249928] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "network-674" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.250535] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.250666] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.250772] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.251247] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.251457] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.251681] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 705.251793] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] NeedRegenerationException {{(pid=69232) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 705.251902] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] no value, waiting for create lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 705.252020] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] value creation lock acquired {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 705.252130] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 705.252336] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Calling creation function for not-yet-present value {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 705.252620] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 705.270216] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.270525] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.270525] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.270760] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.270855] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.271298] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.271480] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.271551] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.271731] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.271836] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.271938] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb3494b9-4ce5-4744-a378-ecbcd5c2bec9 already deleted. [ 705.272101] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.283350] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 705.283528] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Cache value generated in 0.031 seconds for key(s): 'zone-id' {{(pid=69232) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 705.283668] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Released creation lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 705.283844] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "network-674" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.284241] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock port-935f7a22-7870-4f36-95b0-35bcb0117798 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.284428] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "port-935f7a22-7870-4f36-95b0-35bcb0117798" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.284550] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "port-935f7a22-7870-4f36-95b0-35bcb0117798" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.285065] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "port-935f7a22-7870-4f36-95b0-35bcb0117798" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.285065] env[69232]: DEBUG networking_nsxv3.api.rpc [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('935f7a22-7870-4f36-95b0-35bcb0117798',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.458210] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('45780cba-cd94-4a19-b7a8-aa324fdcb9c5',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.474273] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.474569] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.474670] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.474922] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.475034] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.475306] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.475424] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.475509] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.475746] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.475841] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.475928] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 20ba03af-aba0-4fe6-af1e-ea103067fcbe already deleted. [ 705.476386] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-20ba03af-aba0-4fe6-af1e-ea103067fcbe" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.522610] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d0209331-de3e-477d-82f5-64fcd50f25cf',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.692214] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock network-756 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.692408] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "network-756" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.692548] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "network-756" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.692822] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "network-756" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.693231] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.693407] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.693503] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.693733] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.693896] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.694128] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 705.694291] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] NeedRegenerationException {{(pid=69232) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 705.694413] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] no value, waiting for create lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 705.694520] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] value creation lock acquired {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 705.694627] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 705.694728] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Calling creation function for not-yet-present value {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 705.694855] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 705.716709] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 705.717514] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69232) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 705.717514] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Released creation lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 705.717514] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "network-756" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.717665] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock port-c834f9ad-b258-48c4-8c83-2fd75e2e7a2b taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.717790] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "port-c834f9ad-b258-48c4-8c83-2fd75e2e7a2b" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.717910] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "port-c834f9ad-b258-48c4-8c83-2fd75e2e7a2b" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.718343] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "port-c834f9ad-b258-48c4-8c83-2fd75e2e7a2b" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.719087] env[69232]: DEBUG networking_nsxv3.api.rpc [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c834f9ad-b258-48c4-8c83-2fd75e2e7a2b',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.789753] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.789753] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.789753] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.789753] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.789753] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.789753] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Segment Port 935f7a22-7870-4f36-95b0-35bcb0117798 not found, creating... [ 705.789753] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.789753] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.789753] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.789753] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.789753] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.790284] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.790284] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.790284] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.790426] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.791364] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.791364] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Resource: SegmentPort with ID: 935f7a22-7870-4f36-95b0-35bcb0117798 is going to be created. [ 705.815349] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.815587] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.815681] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.816182] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.816536] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.816804] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "port-935f7a22-7870-4f36-95b0-35bcb0117798" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.962543] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 45780cba-cd94-4a19-b7a8-aa324fdcb9c5: rpc.has_security_group_logging(os_id): False [ 705.985291] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.985467] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.985572] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.985782] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.985874] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.986138] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.986238] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.986304] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.986488] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.986588] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.986688] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 45780cba-cd94-4a19-b7a8-aa324fdcb9c5 is going to be created. [ 706.025362] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.025362] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.025362] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.025542] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.025635] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.025735] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d0209331-de3e-477d-82f5-64fcd50f25cf is going to be created. [ 706.060262] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.060474] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.060571] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.060863] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.061009] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.064605] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.064740] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.064797] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.065008] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.065194] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.081927] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d0209331-de3e-477d-82f5-64fcd50f25cf in Status: UNINITIALIZED for 2s [ 706.082536] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 45780cba-cd94-4a19-b7a8-aa324fdcb9c5 in Status: IN_PROGRESS for 2s [ 706.221956] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.221956] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.223161] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.223161] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.223230] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.223449] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Segment Port c834f9ad-b258-48c4-8c83-2fd75e2e7a2b not found, creating... [ 706.223715] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.223908] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.224829] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.224977] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.225053] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.226703] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.227041] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.227239] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.227645] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.227841] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.227943] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Resource: SegmentPort with ID: c834f9ad-b258-48c4-8c83-2fd75e2e7a2b is going to be created. [ 706.259761] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.259761] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.260278] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.260278] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.260356] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.260689] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "port-c834f9ad-b258-48c4-8c83-2fd75e2e7a2b" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.732343] env[69232]: INFO networking_nsxv3.common.synchronization [req-4fd44208-343b-4966-83bc-c5a63cee7a06 req-cf43bd2b-3e65-4cb9-8f8d-bf1d520905be service nova] Enqueued Resource ID: fb3494b9-4ce5-4744-a378-ecbcd5c2bec9 with Priority: HIGHEST for action security_group_rules [ 706.732343] env[69232]: INFO networking_nsxv3.common.synchronization [req-4fd44208-343b-4966-83bc-c5a63cee7a06 req-cf43bd2b-3e65-4cb9-8f8d-bf1d520905be service nova] Enqueued Resource ID: fb3494b9-4ce5-4744-a378-ecbcd5c2bec9 with Priority: HIGHEST for action security_group_members [ 706.732343] env[69232]: INFO networking_nsxv3.common.synchronization [req-4fd44208-343b-4966-83bc-c5a63cee7a06 req-cf43bd2b-3e65-4cb9-8f8d-bf1d520905be service nova] Enqueued Resource ID: 935f7a22-7870-4f36-95b0-35bcb0117798 with Priority: HIGHEST for action port [ 706.732886] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb3494b9-4ce5-4744-a378-ecbcd5c2bec9 with Priority: HIGHEST for action security_group_rules [ 706.733430] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb3494b9-4ce5-4744-a378-ecbcd5c2bec9 with Priority: HIGHEST for action security_group_members [ 706.733430] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 935f7a22-7870-4f36-95b0-35bcb0117798 with Priority: HIGHEST for action port [ 706.733430] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.734497] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.734497] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.734497] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.734497] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fb3494b9-4ce5-4744-a378-ecbcd5c2bec9',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.734851] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.734851] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.734938] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.735140] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.735224] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.735364] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.735407] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.735511] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.735604] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.735691] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fb3494b9-4ce5-4744-a378-ecbcd5c2bec9',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.737190] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-935f7a22-7870-4f36-95b0-35bcb0117798 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.737190] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-935f7a22-7870-4f36-95b0-35bcb0117798" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.737190] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-935f7a22-7870-4f36-95b0-35bcb0117798" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.737190] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-935f7a22-7870-4f36-95b0-35bcb0117798" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.737652] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('935f7a22-7870-4f36-95b0-35bcb0117798',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.009031] env[69232]: INFO networking_nsxv3.common.synchronization [req-1252ca51-b348-469d-bc85-ac581814400b req-b22458cf-4464-46c9-985d-f9726ac21516 service nova] Enqueued Resource ID: 20ba03af-aba0-4fe6-af1e-ea103067fcbe with Priority: HIGHEST for action security_group_rules [ 707.011359] env[69232]: INFO networking_nsxv3.common.synchronization [req-1252ca51-b348-469d-bc85-ac581814400b req-b22458cf-4464-46c9-985d-f9726ac21516 service nova] Enqueued Resource ID: 20ba03af-aba0-4fe6-af1e-ea103067fcbe with Priority: HIGHEST for action security_group_members [ 707.011653] env[69232]: INFO networking_nsxv3.common.synchronization [req-1252ca51-b348-469d-bc85-ac581814400b req-b22458cf-4464-46c9-985d-f9726ac21516 service nova] Enqueued Resource ID: c834f9ad-b258-48c4-8c83-2fd75e2e7a2b with Priority: HIGHEST for action port [ 707.012644] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20ba03af-aba0-4fe6-af1e-ea103067fcbe with Priority: HIGHEST for action security_group_rules [ 707.012891] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20ba03af-aba0-4fe6-af1e-ea103067fcbe with Priority: HIGHEST for action security_group_members [ 707.013109] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c834f9ad-b258-48c4-8c83-2fd75e2e7a2b with Priority: HIGHEST for action port [ 707.014312] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-20ba03af-aba0-4fe6-af1e-ea103067fcbe taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.014312] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-20ba03af-aba0-4fe6-af1e-ea103067fcbe" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.014455] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-20ba03af-aba0-4fe6-af1e-ea103067fcbe" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.015917] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-20ba03af-aba0-4fe6-af1e-ea103067fcbe" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.015917] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('20ba03af-aba0-4fe6-af1e-ea103067fcbe',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.017031] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-20ba03af-aba0-4fe6-af1e-ea103067fcbe taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.017196] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-20ba03af-aba0-4fe6-af1e-ea103067fcbe" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.018747] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-20ba03af-aba0-4fe6-af1e-ea103067fcbe" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.018747] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-20ba03af-aba0-4fe6-af1e-ea103067fcbe" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.018747] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.018747] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.018747] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.018747] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.018747] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.018747] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('20ba03af-aba0-4fe6-af1e-ea103067fcbe',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.019994] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-c834f9ad-b258-48c4-8c83-2fd75e2e7a2b taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.020485] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c834f9ad-b258-48c4-8c83-2fd75e2e7a2b" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.020485] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c834f9ad-b258-48c4-8c83-2fd75e2e7a2b" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.020545] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c834f9ad-b258-48c4-8c83-2fd75e2e7a2b" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.021498] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c834f9ad-b258-48c4-8c83-2fd75e2e7a2b',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.239650] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fb3494b9-4ce5-4744-a378-ecbcd5c2bec9',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.241034] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.241316] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.241371] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 935f7a22-7870-4f36-95b0-35bcb0117798 with status ACTIVE [ 707.241586] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.241685] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.241722] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.241943] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.242060] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.242262] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.242350] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.242391] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.243346] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.243346] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.243346] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.243346] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.243346] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.243346] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.243346] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.243346] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 935f7a22-7870-4f36-95b0-35bcb0117798 is going to be updated. [ 707.270906] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.271445] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.271608] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.271886] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.272117] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.272414] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-935f7a22-7870-4f36-95b0-35bcb0117798" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.518481] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-20ba03af-aba0-4fe6-af1e-ea103067fcbe taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.518481] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-20ba03af-aba0-4fe6-af1e-ea103067fcbe" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.523890] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('20ba03af-aba0-4fe6-af1e-ea103067fcbe',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.524247] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c834f9ad-b258-48c4-8c83-2fd75e2e7a2b with status ACTIVE [ 707.524364] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.524534] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.524589] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.524802] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.525089] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.525165] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.525522] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.525522] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.525522] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.525522] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.525678] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.525764] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.525818] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.525956] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.526307] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.526373] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c834f9ad-b258-48c4-8c83-2fd75e2e7a2b is going to be updated. [ 707.551466] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.551668] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.551668] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.551843] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.551975] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.552140] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c834f9ad-b258-48c4-8c83-2fd75e2e7a2b" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.745653] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fb3494b9-4ce5-4744-a378-ecbcd5c2bec9',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.028397] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('20ba03af-aba0-4fe6-af1e-ea103067fcbe',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.093754] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d0209331-de3e-477d-82f5-64fcd50f25cf in Status: SUCCESS [ 708.093754] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0209331-de3e-477d-82f5-64fcd50f25cf" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.093754] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0209331-de3e-477d-82f5-64fcd50f25cf" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.093950] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0209331-de3e-477d-82f5-64fcd50f25cf" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.095102] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.095102] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.095102] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.095102] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.095102] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.095102] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0209331-de3e-477d-82f5-64fcd50f25cf" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.095102] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d0209331-de3e-477d-82f5-64fcd50f25cf',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.096188] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 45780cba-cd94-4a19-b7a8-aa324fdcb9c5 in Status: SUCCESS [ 708.096383] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-45780cba-cd94-4a19-b7a8-aa324fdcb9c5" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.248012] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.248298] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.248298] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.248543] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.248687] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.248831] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb3494b9-4ce5-4744-a378-ecbcd5c2bec9 is going to be created. [ 708.275687] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.275938] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.276064] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.276392] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.276687] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.288994] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb3494b9-4ce5-4744-a378-ecbcd5c2bec9 in Status: UNINITIALIZED for 2s [ 708.532829] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.535585] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.535585] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.535585] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.535585] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.535585] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 20ba03af-aba0-4fe6-af1e-ea103067fcbe is going to be created. [ 708.563391] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.563391] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.563391] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.563391] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.563391] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.574469] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 20ba03af-aba0-4fe6-af1e-ea103067fcbe in Status: UNINITIALIZED for 2s [ 708.601614] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0209331-de3e-477d-82f5-64fcd50f25cf taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.601614] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0209331-de3e-477d-82f5-64fcd50f25cf" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.601614] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0209331-de3e-477d-82f5-64fcd50f25cf" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.601614] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0209331-de3e-477d-82f5-64fcd50f25cf" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.601614] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.601614] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.601614] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.601614] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.601614] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.601614] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0209331-de3e-477d-82f5-64fcd50f25cf" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.602388] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0209331-de3e-477d-82f5-64fcd50f25cf taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.602864] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0209331-de3e-477d-82f5-64fcd50f25cf" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.603177] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0209331-de3e-477d-82f5-64fcd50f25cf" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.603613] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0209331-de3e-477d-82f5-64fcd50f25cf" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.606027] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.606027] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.606027] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.606027] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.606027] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.606027] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0209331-de3e-477d-82f5-64fcd50f25cf" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.606027] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d0209331-de3e-477d-82f5-64fcd50f25cf',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.107799] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d0209331-de3e-477d-82f5-64fcd50f25cf: rpc.has_security_group_logging(os_id): False [ 709.131742] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.132295] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.132479] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.132806] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.134182] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.134531] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.135422] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.135422] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.135422] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.135422] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.135422] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.135696] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.135845] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.136683] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.136791] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.137047] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.137130] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.137202] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.137360] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.137441] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.137529] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d0209331-de3e-477d-82f5-64fcd50f25cf is going to be created. [ 709.242933] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.243245] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.243355] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.243798] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.244184] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.258538] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d0209331-de3e-477d-82f5-64fcd50f25cf in Status: IN_PROGRESS for 2s [ 710.299242] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb3494b9-4ce5-4744-a378-ecbcd5c2bec9 in Status: SUCCESS [ 710.299577] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.300214] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.300214] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.300214] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.300214] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.300522] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.300522] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.300522] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.300609] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.301014] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fb3494b9-4ce5-4744-a378-ecbcd5c2bec9',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.567024] env[69232]: INFO networking_nsxv3.common.synchronization [req-6379898e-7bb6-46b1-a81d-f444e7d5dde2 req-1f966262-e415-4933-bc84-5ced498a96f8 tempest-ServersNegativeTestMultiTenantJSON-1523884426 tempest-ServersNegativeTestMultiTenantJSON-1523884426-project-member] Enqueued Resource ID: d95c4c9e-2568-4fbb-8231-ae683e08215e with Priority: HIGHEST for action security_group_members [ 710.567024] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d95c4c9e-2568-4fbb-8231-ae683e08215e with Priority: HIGHEST for action security_group_members [ 710.567024] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-d95c4c9e-2568-4fbb-8231-ae683e08215e taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.567024] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d95c4c9e-2568-4fbb-8231-ae683e08215e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.567024] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d95c4c9e-2568-4fbb-8231-ae683e08215e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.567024] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d95c4c9e-2568-4fbb-8231-ae683e08215e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.567024] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.567024] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.567024] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.567024] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.567024] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.567024] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d95c4c9e-2568-4fbb-8231-ae683e08215e',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.588366] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 20ba03af-aba0-4fe6-af1e-ea103067fcbe in Status: SUCCESS [ 710.591163] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-20ba03af-aba0-4fe6-af1e-ea103067fcbe" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.591163] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-20ba03af-aba0-4fe6-af1e-ea103067fcbe" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.591163] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-20ba03af-aba0-4fe6-af1e-ea103067fcbe" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.591163] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.591163] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.591163] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.591163] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.591163] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.591163] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-20ba03af-aba0-4fe6-af1e-ea103067fcbe" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.591163] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('20ba03af-aba0-4fe6-af1e-ea103067fcbe',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.803774] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.807022] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.807022] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.807022] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.807022] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.807022] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.807022] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.807022] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.807022] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.807022] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.807022] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.807022] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.807022] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.807022] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.807022] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.807022] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.807022] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.807022] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.807022] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.808084] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.808084] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fb3494b9-4ce5-4744-a378-ecbcd5c2bec9',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.071950] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.072235] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.072391] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.072705] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.072880] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.073211] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.073470] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.073470] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.073798] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.073977] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.074149] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d95c4c9e-2568-4fbb-8231-ae683e08215e is going to be updated. [ 711.098143] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-20ba03af-aba0-4fe6-af1e-ea103067fcbe taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.099174] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-20ba03af-aba0-4fe6-af1e-ea103067fcbe" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.099174] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-20ba03af-aba0-4fe6-af1e-ea103067fcbe" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.099174] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-20ba03af-aba0-4fe6-af1e-ea103067fcbe" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.099174] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.099174] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.099174] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.099174] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.099431] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.099473] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-20ba03af-aba0-4fe6-af1e-ea103067fcbe" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.099746] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-20ba03af-aba0-4fe6-af1e-ea103067fcbe taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.099746] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-20ba03af-aba0-4fe6-af1e-ea103067fcbe" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.099868] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-20ba03af-aba0-4fe6-af1e-ea103067fcbe" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.099995] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-20ba03af-aba0-4fe6-af1e-ea103067fcbe" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.103501] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.103656] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.103726] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.104148] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.104277] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.104413] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-20ba03af-aba0-4fe6-af1e-ea103067fcbe" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.104554] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('20ba03af-aba0-4fe6-af1e-ea103067fcbe',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.113768] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.114944] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.114944] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.117332] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.117332] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.131220] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d95c4c9e-2568-4fbb-8231-ae683e08215e in Status: IN_PROGRESS for 2s [ 711.275227] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d0209331-de3e-477d-82f5-64fcd50f25cf in Status: SUCCESS [ 711.275580] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d0209331-de3e-477d-82f5-64fcd50f25cf" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.314718] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fb3494b9-4ce5-4744-a378-ecbcd5c2bec9: rpc.has_security_group_logging(os_id): False [ 711.342873] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.343207] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.343365] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.344033] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.344033] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.344175] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.344373] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.344534] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.344784] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.344942] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.346758] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.346758] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.346758] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.347016] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.347016] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.347236] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.347368] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.347499] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.347649] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.347800] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.347845] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fb3494b9-4ce5-4744-a378-ecbcd5c2bec9 is going to be created. [ 711.421595] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.421595] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.421595] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.421856] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.421998] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.437553] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fb3494b9-4ce5-4744-a378-ecbcd5c2bec9 in Status: IN_PROGRESS for 2s [ 711.609758] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 20ba03af-aba0-4fe6-af1e-ea103067fcbe: rpc.has_security_group_logging(os_id): False [ 711.638449] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.638449] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.638449] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.638449] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.638449] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.638449] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.638449] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.638449] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.638449] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.638449] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.638449] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.638449] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.638449] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.638449] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.638449] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.638912] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.639620] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.639793] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.640113] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.640231] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.640373] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 20ba03af-aba0-4fe6-af1e-ea103067fcbe is going to be created. [ 711.742946] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.743191] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.743274] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.743598] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.743829] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.770116] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 20ba03af-aba0-4fe6-af1e-ea103067fcbe in Status: IN_PROGRESS for 2s [ 713.143589] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d95c4c9e-2568-4fbb-8231-ae683e08215e in Status: SUCCESS [ 713.143589] env[69232]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d95c4c9e-2568-4fbb-8231-ae683e08215e deletion is rescheduled due to dependency. [ 713.143589] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d95c4c9e-2568-4fbb-8231-ae683e08215e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.457058] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fb3494b9-4ce5-4744-a378-ecbcd5c2bec9 in Status: SUCCESS [ 713.457565] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.785888] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 20ba03af-aba0-4fe6-af1e-ea103067fcbe in Status: SUCCESS [ 713.786203] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-20ba03af-aba0-4fe6-af1e-ea103067fcbe" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.643242] env[69232]: INFO networking_nsxv3.common.synchronization [None req-d047e6f3-00bb-43be-89de-e69c167189e6 None None] Enqueued Resource ID: 496eb501-8daa-4cfd-a0bd-bc8cc5b461f8 with Priority: HIGHEST for action port [ 714.643508] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 496eb501-8daa-4cfd-a0bd-bc8cc5b461f8 with Priority: HIGHEST for action port [ 714.644084] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-496eb501-8daa-4cfd-a0bd-bc8cc5b461f8 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.644213] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-496eb501-8daa-4cfd-a0bd-bc8cc5b461f8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.644280] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-496eb501-8daa-4cfd-a0bd-bc8cc5b461f8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.644540] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-496eb501-8daa-4cfd-a0bd-bc8cc5b461f8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.644623] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('496eb501-8daa-4cfd-a0bd-bc8cc5b461f8',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.729392] env[69232]: INFO networking_nsxv3.common.synchronization [req-7c648f4e-f3f1-44c3-be80-03aa033ac1d1 req-b8b8165d-b658-4755-ae54-b1cd7a231580 tempest-TenantUsagesTestJSON-1506958894 tempest-TenantUsagesTestJSON-1506958894-project-member] Enqueued Resource ID: 96a06bfd-a7ad-4644-89c3-3168aa1fdf2e with Priority: HIGHEST for action security_group_members [ 714.730032] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 96a06bfd-a7ad-4644-89c3-3168aa1fdf2e with Priority: HIGHEST for action security_group_members [ 714.730300] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-96a06bfd-a7ad-4644-89c3-3168aa1fdf2e taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.730437] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-96a06bfd-a7ad-4644-89c3-3168aa1fdf2e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.730532] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-96a06bfd-a7ad-4644-89c3-3168aa1fdf2e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.730776] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-96a06bfd-a7ad-4644-89c3-3168aa1fdf2e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.730944] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.731116] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.731172] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.731595] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.731696] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.731796] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('96a06bfd-a7ad-4644-89c3-3168aa1fdf2e',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.154000] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 496eb501-8daa-4cfd-a0bd-bc8cc5b461f8 [ 715.154115] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.154278] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.154334] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.154501] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.154593] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.154701] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:496eb501-8daa-4cfd-a0bd-bc8cc5b461f8 already deleted. [ 715.154781] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-496eb501-8daa-4cfd-a0bd-bc8cc5b461f8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.235705] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.235705] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.235705] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.235705] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.235705] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.235705] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.235705] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.235705] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.236114] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.236114] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.236114] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 96a06bfd-a7ad-4644-89c3-3168aa1fdf2e is going to be updated. [ 715.269806] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.269997] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.270088] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.270278] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.270415] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.288499] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 96a06bfd-a7ad-4644-89c3-3168aa1fdf2e in Status: IN_PROGRESS for 2s [ 715.525702] env[69232]: INFO networking_nsxv3.common.synchronization [req-07b5101d-8130-4322-bbd4-57605f1589e0 req-d45e0c95-a110-4c16-aaca-f399a6fcbfae tempest-ServersAdminNegativeTestJSON-879816592 tempest-ServersAdminNegativeTestJSON-879816592-project-member] Enqueued Resource ID: 256e29a3-9ff8-45a1-805b-591f83c2a8b4 with Priority: HIGHEST for action security_group_members [ 715.530356] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 256e29a3-9ff8-45a1-805b-591f83c2a8b4 with Priority: HIGHEST for action security_group_members [ 715.530356] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-256e29a3-9ff8-45a1-805b-591f83c2a8b4 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.530356] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-256e29a3-9ff8-45a1-805b-591f83c2a8b4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.530356] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-256e29a3-9ff8-45a1-805b-591f83c2a8b4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.530356] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-256e29a3-9ff8-45a1-805b-591f83c2a8b4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.530356] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.530356] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.530356] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.530356] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.530356] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.530356] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('256e29a3-9ff8-45a1-805b-591f83c2a8b4',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.032944] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.033349] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.033349] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.033475] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.033475] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.033654] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.033759] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.033812] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.033950] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.034041] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.034128] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 256e29a3-9ff8-45a1-805b-591f83c2a8b4 already deleted. [ 716.034206] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-256e29a3-9ff8-45a1-805b-591f83c2a8b4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.748522] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock network-225 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.748787] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "network-225" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.748846] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "network-225" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.749130] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "network-225" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.749402] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.749645] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.749702] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.749882] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.751074] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.751372] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 716.755021] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] NeedRegenerationException {{(pid=69232) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 716.755021] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] no value, waiting for create lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 716.755021] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] value creation lock acquired {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 716.755021] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 716.755021] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Calling creation function for not-yet-present value {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 716.755021] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 716.773864] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 716.774036] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69232) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 716.774170] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Released creation lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 716.774340] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "network-225" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.774665] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock port-fd1e8d16-8e4e-489e-b6c6-aff83da86ea7 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.774859] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "port-fd1e8d16-8e4e-489e-b6c6-aff83da86ea7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.775050] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "port-fd1e8d16-8e4e-489e-b6c6-aff83da86ea7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.775408] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "port-fd1e8d16-8e4e-489e-b6c6-aff83da86ea7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.775542] env[69232]: DEBUG networking_nsxv3.api.rpc [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fd1e8d16-8e4e-489e-b6c6-aff83da86ea7',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.282271] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.288243] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.288243] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.288243] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.288243] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.288243] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Segment Port fd1e8d16-8e4e-489e-b6c6-aff83da86ea7 not found, creating... [ 717.288243] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.288243] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.288243] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.288243] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.288243] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.288633] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.288633] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.288633] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.288927] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.289208] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.289465] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Resource: SegmentPort with ID: fd1e8d16-8e4e-489e-b6c6-aff83da86ea7 is going to be created. [ 717.307513] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 96a06bfd-a7ad-4644-89c3-3168aa1fdf2e in Status: SUCCESS [ 717.307758] env[69232]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 96a06bfd-a7ad-4644-89c3-3168aa1fdf2e deletion is rescheduled due to dependency. [ 717.307830] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-96a06bfd-a7ad-4644-89c3-3168aa1fdf2e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.313436] env[69232]: INFO networking_nsxv3.common.synchronization [None req-827469ae-1aca-4de4-848d-5c4d0fe8ca1b None None] Enqueued Resource ID: 0a56f75d-e8f4-4771-87f6-6637904d8118 with Priority: HIGHEST for action port [ 717.313436] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a56f75d-e8f4-4771-87f6-6637904d8118 with Priority: HIGHEST for action port [ 717.313905] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-0a56f75d-e8f4-4771-87f6-6637904d8118 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.314063] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0a56f75d-e8f4-4771-87f6-6637904d8118" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.314133] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0a56f75d-e8f4-4771-87f6-6637904d8118" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.314454] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0a56f75d-e8f4-4771-87f6-6637904d8118" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.314500] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0a56f75d-e8f4-4771-87f6-6637904d8118',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.319336] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.319336] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.319336] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.320135] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.320135] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.320320] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "port-fd1e8d16-8e4e-489e-b6c6-aff83da86ea7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.823699] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0a56f75d-e8f4-4771-87f6-6637904d8118 [ 717.823935] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.825028] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.825028] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.825028] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.825028] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.825028] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0a56f75d-e8f4-4771-87f6-6637904d8118 already deleted. [ 717.825028] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0a56f75d-e8f4-4771-87f6-6637904d8118" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.211780] env[69232]: INFO networking_nsxv3.common.synchronization [req-dc5b9b4a-7270-4ec8-a6eb-3d2ddebc2516 req-3ec52515-7ed6-48a2-b8e8-bd9ca43c394c tempest-ServerGroupTestJSON-1414402668 tempest-ServerGroupTestJSON-1414402668-project-member] Enqueued Resource ID: d0209331-de3e-477d-82f5-64fcd50f25cf with Priority: HIGHEST for action security_group_members [ 718.211780] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0209331-de3e-477d-82f5-64fcd50f25cf with Priority: HIGHEST for action security_group_members [ 718.213048] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0209331-de3e-477d-82f5-64fcd50f25cf taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.213048] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0209331-de3e-477d-82f5-64fcd50f25cf" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.213048] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0209331-de3e-477d-82f5-64fcd50f25cf" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.214344] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0209331-de3e-477d-82f5-64fcd50f25cf" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.214344] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.214431] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.214465] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.214776] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.214776] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.215528] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d0209331-de3e-477d-82f5-64fcd50f25cf',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.254736] env[69232]: INFO networking_nsxv3.common.synchronization [None req-f366c966-40b5-48c5-bf6c-5c3a983508a4 None None] Enqueued Resource ID: c432042c-10ff-4588-8eb0-907527c135cf with Priority: HIGHEST for action port [ 718.255284] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c432042c-10ff-4588-8eb0-907527c135cf with Priority: HIGHEST for action port [ 718.256697] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-c432042c-10ff-4588-8eb0-907527c135cf taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.257194] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c432042c-10ff-4588-8eb0-907527c135cf" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.257194] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c432042c-10ff-4588-8eb0-907527c135cf" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.257296] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c432042c-10ff-4588-8eb0-907527c135cf" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.257296] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c432042c-10ff-4588-8eb0-907527c135cf',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.717850] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.718212] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.718212] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.718282] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.718355] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.718553] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.718652] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.718711] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.718863] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.718932] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.719054] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d0209331-de3e-477d-82f5-64fcd50f25cf is going to be updated. [ 718.751533] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.751731] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.751731] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.752037] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.752117] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.761105] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d0209331-de3e-477d-82f5-64fcd50f25cf in Status: IN_PROGRESS for 2s [ 718.761376] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c432042c-10ff-4588-8eb0-907527c135cf [ 718.761437] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.761519] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.761614] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.761806] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.761897] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.761989] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c432042c-10ff-4588-8eb0-907527c135cf already deleted. [ 718.762080] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c432042c-10ff-4588-8eb0-907527c135cf" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.910035] env[69232]: INFO networking_nsxv3.common.synchronization [req-07b5101d-8130-4322-bbd4-57605f1589e0 req-f51f39b9-a580-4af7-bac7-b9ca0bdeaa7e service nova] Enqueued Resource ID: 256e29a3-9ff8-45a1-805b-591f83c2a8b4 with Priority: HIGHEST for action security_group_rules [ 718.910280] env[69232]: INFO networking_nsxv3.common.synchronization [req-07b5101d-8130-4322-bbd4-57605f1589e0 req-f51f39b9-a580-4af7-bac7-b9ca0bdeaa7e service nova] Enqueued Resource ID: 256e29a3-9ff8-45a1-805b-591f83c2a8b4 with Priority: HIGHEST for action security_group_members [ 718.910423] env[69232]: INFO networking_nsxv3.common.synchronization [req-07b5101d-8130-4322-bbd4-57605f1589e0 req-f51f39b9-a580-4af7-bac7-b9ca0bdeaa7e service nova] Enqueued Resource ID: fd1e8d16-8e4e-489e-b6c6-aff83da86ea7 with Priority: HIGHEST for action port [ 718.911074] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 256e29a3-9ff8-45a1-805b-591f83c2a8b4 with Priority: HIGHEST for action security_group_rules [ 718.912187] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 256e29a3-9ff8-45a1-805b-591f83c2a8b4 with Priority: HIGHEST for action security_group_members [ 718.912187] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd1e8d16-8e4e-489e-b6c6-aff83da86ea7 with Priority: HIGHEST for action port [ 718.912187] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-256e29a3-9ff8-45a1-805b-591f83c2a8b4 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.917043] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-256e29a3-9ff8-45a1-805b-591f83c2a8b4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.917043] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-256e29a3-9ff8-45a1-805b-591f83c2a8b4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.917043] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-256e29a3-9ff8-45a1-805b-591f83c2a8b4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.917043] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('256e29a3-9ff8-45a1-805b-591f83c2a8b4',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.917043] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-256e29a3-9ff8-45a1-805b-591f83c2a8b4 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.917043] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-256e29a3-9ff8-45a1-805b-591f83c2a8b4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.917043] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-256e29a3-9ff8-45a1-805b-591f83c2a8b4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.917043] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-256e29a3-9ff8-45a1-805b-591f83c2a8b4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.917043] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.917043] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.917043] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.921139] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.921139] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.921139] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('256e29a3-9ff8-45a1-805b-591f83c2a8b4',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.921139] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-fd1e8d16-8e4e-489e-b6c6-aff83da86ea7 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.921139] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fd1e8d16-8e4e-489e-b6c6-aff83da86ea7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.921139] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fd1e8d16-8e4e-489e-b6c6-aff83da86ea7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.921139] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fd1e8d16-8e4e-489e-b6c6-aff83da86ea7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.921139] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fd1e8d16-8e4e-489e-b6c6-aff83da86ea7',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.926842] env[69232]: INFO networking_nsxv3.common.synchronization [None req-132f80e0-a617-4d65-989e-ed38958327e1 None None] Enqueued Resource ID: d61fb6af-290a-4dd1-af08-436e7a29ba0f with Priority: HIGHEST for action port [ 718.928186] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d61fb6af-290a-4dd1-af08-436e7a29ba0f with Priority: HIGHEST for action port [ 718.929238] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-d61fb6af-290a-4dd1-af08-436e7a29ba0f taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.929365] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d61fb6af-290a-4dd1-af08-436e7a29ba0f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.929448] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d61fb6af-290a-4dd1-af08-436e7a29ba0f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.929867] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d61fb6af-290a-4dd1-af08-436e7a29ba0f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.930028] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d61fb6af-290a-4dd1-af08-436e7a29ba0f',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.421923] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-256e29a3-9ff8-45a1-805b-591f83c2a8b4 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.422115] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-256e29a3-9ff8-45a1-805b-591f83c2a8b4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.426956] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('256e29a3-9ff8-45a1-805b-591f83c2a8b4',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.430224] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fd1e8d16-8e4e-489e-b6c6-aff83da86ea7 with status ACTIVE [ 719.430224] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.430224] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.430224] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.430224] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.430224] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.430224] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.430224] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.430224] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.430224] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.430224] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.430630] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.430630] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.430630] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.430630] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.430741] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.430766] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fd1e8d16-8e4e-489e-b6c6-aff83da86ea7 is going to be updated. [ 719.433766] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d61fb6af-290a-4dd1-af08-436e7a29ba0f [ 719.433766] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.434777] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.434777] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.434777] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.434777] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.434777] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d61fb6af-290a-4dd1-af08-436e7a29ba0f already deleted. [ 719.434777] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d61fb6af-290a-4dd1-af08-436e7a29ba0f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.464448] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.464656] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.464656] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.464861] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.465025] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.465187] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fd1e8d16-8e4e-489e-b6c6-aff83da86ea7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.935037] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('256e29a3-9ff8-45a1-805b-591f83c2a8b4',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.348489] env[69232]: INFO networking_nsxv3.common.synchronization [None req-46a8efe3-aa82-4202-9077-56adc5284fc6 None None] Enqueued Resource ID: 2af9a96b-eeaa-466b-9439-f1031cce887c with Priority: HIGHEST for action port [ 720.351042] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2af9a96b-eeaa-466b-9439-f1031cce887c with Priority: HIGHEST for action port [ 720.351042] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-2af9a96b-eeaa-466b-9439-f1031cce887c taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.351042] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2af9a96b-eeaa-466b-9439-f1031cce887c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.351042] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2af9a96b-eeaa-466b-9439-f1031cce887c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.352684] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2af9a96b-eeaa-466b-9439-f1031cce887c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.352684] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2af9a96b-eeaa-466b-9439-f1031cce887c',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.443811] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.443811] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.443811] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.444120] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.444120] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.445490] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 256e29a3-9ff8-45a1-805b-591f83c2a8b4 is going to be created. [ 720.478095] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.478095] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.478095] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.478449] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.478449] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.490144] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 256e29a3-9ff8-45a1-805b-591f83c2a8b4 in Status: UNINITIALIZED for 2s [ 720.775799] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d0209331-de3e-477d-82f5-64fcd50f25cf in Status: SUCCESS [ 720.775799] env[69232]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d0209331-de3e-477d-82f5-64fcd50f25cf deletion is rescheduled due to dependency. [ 720.775799] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0209331-de3e-477d-82f5-64fcd50f25cf" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.854286] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2af9a96b-eeaa-466b-9439-f1031cce887c [ 720.854520] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.854610] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.854655] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.854945] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.855049] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.855155] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2af9a96b-eeaa-466b-9439-f1031cce887c already deleted. [ 720.855227] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2af9a96b-eeaa-466b-9439-f1031cce887c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.045167] env[69232]: INFO networking_nsxv3.common.synchronization [None req-70a1ba75-5e0a-494a-b555-717ea6c9acd9 tempest-ServerActionsTestJSON-973196373 tempest-ServerActionsTestJSON-973196373-project-member] Enqueued Resource ID: 1eb9f24d-331e-450b-9da0-82652ecba032 with Priority: HIGHEST for action security_group_rules [ 721.048814] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1eb9f24d-331e-450b-9da0-82652ecba032 with Priority: HIGHEST for action security_group_rules [ 721.048814] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1eb9f24d-331e-450b-9da0-82652ecba032 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.048814] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1eb9f24d-331e-450b-9da0-82652ecba032" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.048814] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1eb9f24d-331e-450b-9da0-82652ecba032" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.048814] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1eb9f24d-331e-450b-9da0-82652ecba032" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.048814] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1eb9f24d-331e-450b-9da0-82652ecba032',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.321879] env[69232]: INFO networking_nsxv3.common.synchronization [None req-a14e68f0-2e4b-40ec-9fae-5f077c1e607d tempest-ServerActionsTestJSON-973196373 tempest-ServerActionsTestJSON-973196373-project-member] Enqueued Resource ID: 1eb9f24d-331e-450b-9da0-82652ecba032 with Priority: HIGHEST for action security_group_rules [ 721.323051] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1eb9f24d-331e-450b-9da0-82652ecba032 with Priority: HIGHEST for action security_group_rules [ 721.323051] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1eb9f24d-331e-450b-9da0-82652ecba032 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.327066] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1eb9f24d-331e-450b-9da0-82652ecba032" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.405997] env[69232]: INFO networking_nsxv3.common.synchronization [None req-f1c87beb-6e8a-4666-b27f-9a631e9e6df4 None None] Enqueued Resource ID: 10e0d0e9-1bf0-44db-8ced-6d74abbcb5bb with Priority: HIGHEST for action port [ 721.406647] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 10e0d0e9-1bf0-44db-8ced-6d74abbcb5bb with Priority: HIGHEST for action port [ 721.406978] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-10e0d0e9-1bf0-44db-8ced-6d74abbcb5bb taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.408159] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-10e0d0e9-1bf0-44db-8ced-6d74abbcb5bb" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.408159] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-10e0d0e9-1bf0-44db-8ced-6d74abbcb5bb" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.408394] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-10e0d0e9-1bf0-44db-8ced-6d74abbcb5bb" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.408486] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('10e0d0e9-1bf0-44db-8ced-6d74abbcb5bb',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.575464] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.575464] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.575464] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.575464] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.575749] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.575749] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1eb9f24d-331e-450b-9da0-82652ecba032 already deleted. [ 721.576549] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1eb9f24d-331e-450b-9da0-82652ecba032" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.576549] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1eb9f24d-331e-450b-9da0-82652ecba032" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.576549] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1eb9f24d-331e-450b-9da0-82652ecba032" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.576549] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1eb9f24d-331e-450b-9da0-82652ecba032',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.910937] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 10e0d0e9-1bf0-44db-8ced-6d74abbcb5bb [ 721.911316] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.911467] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.911793] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.912212] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.912212] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.914356] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:10e0d0e9-1bf0-44db-8ced-6d74abbcb5bb already deleted. [ 721.914356] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-10e0d0e9-1bf0-44db-8ced-6d74abbcb5bb" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.914356] env[69232]: INFO networking_nsxv3.common.synchronization [None req-855d8eaa-e12a-44c1-8fbc-ada0b1f24733 None None] Enqueued Resource ID: ca5b6872-5f24-49ab-91c6-d83c1bbcd2f0 with Priority: HIGHEST for action port [ 721.914356] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca5b6872-5f24-49ab-91c6-d83c1bbcd2f0 with Priority: HIGHEST for action port [ 721.914356] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-ca5b6872-5f24-49ab-91c6-d83c1bbcd2f0 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.914654] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ca5b6872-5f24-49ab-91c6-d83c1bbcd2f0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.914654] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ca5b6872-5f24-49ab-91c6-d83c1bbcd2f0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.914843] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ca5b6872-5f24-49ab-91c6-d83c1bbcd2f0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.917973] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ca5b6872-5f24-49ab-91c6-d83c1bbcd2f0',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.100505] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.100926] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.100926] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.101183] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.101183] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.101183] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1eb9f24d-331e-450b-9da0-82652ecba032 already deleted. [ 722.102708] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1eb9f24d-331e-450b-9da0-82652ecba032" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.420422] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ca5b6872-5f24-49ab-91c6-d83c1bbcd2f0 [ 722.420660] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.422929] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.423169] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.423979] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.423979] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.423979] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ca5b6872-5f24-49ab-91c6-d83c1bbcd2f0 already deleted. [ 722.423979] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ca5b6872-5f24-49ab-91c6-d83c1bbcd2f0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.500864] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 256e29a3-9ff8-45a1-805b-591f83c2a8b4 in Status: SUCCESS [ 722.501112] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-256e29a3-9ff8-45a1-805b-591f83c2a8b4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.501355] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-256e29a3-9ff8-45a1-805b-591f83c2a8b4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.501618] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-256e29a3-9ff8-45a1-805b-591f83c2a8b4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.501817] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.501960] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.501990] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.502165] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.502918] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.502918] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-256e29a3-9ff8-45a1-805b-591f83c2a8b4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.502918] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('256e29a3-9ff8-45a1-805b-591f83c2a8b4',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.005691] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-256e29a3-9ff8-45a1-805b-591f83c2a8b4 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.006268] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-256e29a3-9ff8-45a1-805b-591f83c2a8b4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.006998] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-256e29a3-9ff8-45a1-805b-591f83c2a8b4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.006998] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-256e29a3-9ff8-45a1-805b-591f83c2a8b4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.006998] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.007199] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.007231] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.007539] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.007635] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.007779] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-256e29a3-9ff8-45a1-805b-591f83c2a8b4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.008013] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-256e29a3-9ff8-45a1-805b-591f83c2a8b4 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.008151] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-256e29a3-9ff8-45a1-805b-591f83c2a8b4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.008241] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-256e29a3-9ff8-45a1-805b-591f83c2a8b4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.008450] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-256e29a3-9ff8-45a1-805b-591f83c2a8b4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.008688] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.008832] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.008888] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.010532] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.012915] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.013450] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-256e29a3-9ff8-45a1-805b-591f83c2a8b4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.014487] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('256e29a3-9ff8-45a1-805b-591f83c2a8b4',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.019274] env[69232]: INFO networking_nsxv3.common.synchronization [req-7efc0573-dc81-4cd8-bce1-249a930e4429 req-d02d374b-05ef-46df-a577-f47451d1c4e2 tempest-AttachInterfacesTestJSON-1442903876 tempest-AttachInterfacesTestJSON-1442903876-project-member] Enqueued Resource ID: 20ba03af-aba0-4fe6-af1e-ea103067fcbe with Priority: HIGHEST for action security_group_members [ 723.020602] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20ba03af-aba0-4fe6-af1e-ea103067fcbe with Priority: HIGHEST for action security_group_members [ 723.021584] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-20ba03af-aba0-4fe6-af1e-ea103067fcbe taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.022775] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-20ba03af-aba0-4fe6-af1e-ea103067fcbe" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.023436] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-20ba03af-aba0-4fe6-af1e-ea103067fcbe" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.023826] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-20ba03af-aba0-4fe6-af1e-ea103067fcbe" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.026331] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.026331] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.026331] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.026331] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.026948] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.026948] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('20ba03af-aba0-4fe6-af1e-ea103067fcbe',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.387242] env[69232]: INFO networking_nsxv3.common.synchronization [None req-2643d96b-add1-45ad-a330-4075f856b6fd None None] Enqueued Resource ID: 77770189-190e-41fb-81c4-a858faa4ccd9 with Priority: HIGHEST for action port [ 723.387517] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77770189-190e-41fb-81c4-a858faa4ccd9 with Priority: HIGHEST for action port [ 723.388108] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-77770189-190e-41fb-81c4-a858faa4ccd9 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.388669] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-77770189-190e-41fb-81c4-a858faa4ccd9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.388669] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-77770189-190e-41fb-81c4-a858faa4ccd9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.388918] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-77770189-190e-41fb-81c4-a858faa4ccd9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.389011] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('77770189-190e-41fb-81c4-a858faa4ccd9',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.520118] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 256e29a3-9ff8-45a1-805b-591f83c2a8b4: rpc.has_security_group_logging(os_id): False [ 723.529402] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.529553] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.529636] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.529821] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.529913] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.530122] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.530231] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.530340] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.530441] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.530514] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.530598] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 20ba03af-aba0-4fe6-af1e-ea103067fcbe is going to be updated. [ 723.543553] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.543771] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.543771] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.544047] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.544185] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.544402] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.544506] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.544683] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.544738] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.544822] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.545185] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.545185] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.545185] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.545325] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.545325] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.545507] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.545601] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.545664] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.546766] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.546891] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.546988] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 256e29a3-9ff8-45a1-805b-591f83c2a8b4 is going to be created. [ 723.571276] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.571276] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.571276] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.571276] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.571276] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.587587] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 20ba03af-aba0-4fe6-af1e-ea103067fcbe in Status: IN_PROGRESS for 2s [ 723.638472] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.638842] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.640068] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.640381] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.640585] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.655940] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 256e29a3-9ff8-45a1-805b-591f83c2a8b4 in Status: IN_PROGRESS for 2s [ 723.656515] env[69232]: INFO networking_nsxv3.common.synchronization [None req-18b5503d-0bd2-4112-872e-86999406e840 None None] Enqueued Resource ID: 7676f72e-7d48-4518-8852-5514efe3f980 with Priority: HIGHEST for action port [ 723.657291] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7676f72e-7d48-4518-8852-5514efe3f980 with Priority: HIGHEST for action port [ 723.657783] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-7676f72e-7d48-4518-8852-5514efe3f980 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.657890] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7676f72e-7d48-4518-8852-5514efe3f980" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.657965] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7676f72e-7d48-4518-8852-5514efe3f980" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.658240] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7676f72e-7d48-4518-8852-5514efe3f980" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.658322] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7676f72e-7d48-4518-8852-5514efe3f980',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.899033] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 77770189-190e-41fb-81c4-a858faa4ccd9 [ 723.899033] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.899033] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.899033] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.899033] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.899033] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.899033] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:77770189-190e-41fb-81c4-a858faa4ccd9 already deleted. [ 723.899033] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-77770189-190e-41fb-81c4-a858faa4ccd9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.986564] env[69232]: INFO networking_nsxv3.common.synchronization [req-e67031b1-2e26-4395-98a2-9515164d2cbf req-51fa27ab-f34e-4036-b082-dd86bf76aec5 tempest-ImagesOneServerTestJSON-1049093456 tempest-ImagesOneServerTestJSON-1049093456-project-member] Enqueued Resource ID: abd587ac-a2db-4962-b166-638ba1590646 with Priority: HIGHEST for action security_group_members [ 723.987521] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: abd587ac-a2db-4962-b166-638ba1590646 with Priority: HIGHEST for action security_group_members [ 723.987911] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-abd587ac-a2db-4962-b166-638ba1590646 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.988066] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-abd587ac-a2db-4962-b166-638ba1590646" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.988154] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-abd587ac-a2db-4962-b166-638ba1590646" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.989236] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-abd587ac-a2db-4962-b166-638ba1590646" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.989236] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.989236] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.989236] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.989236] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.989236] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.989236] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('abd587ac-a2db-4962-b166-638ba1590646',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.161354] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7676f72e-7d48-4518-8852-5514efe3f980 [ 724.162539] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.162539] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.162539] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.162539] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.162539] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.162539] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7676f72e-7d48-4518-8852-5514efe3f980 already deleted. [ 724.162539] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7676f72e-7d48-4518-8852-5514efe3f980" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.494349] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.494349] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.494349] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.494349] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.494349] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.494788] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.494788] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.494788] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.494893] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.494989] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.495149] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: abd587ac-a2db-4962-b166-638ba1590646 is going to be updated. [ 724.542241] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.542241] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.542241] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.542241] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.542241] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.551779] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: abd587ac-a2db-4962-b166-638ba1590646 in Status: IN_PROGRESS for 2s [ 725.559266] env[69232]: INFO networking_nsxv3.common.synchronization [req-49e1804b-ca82-42f0-a307-77db2cb8f5c4 req-137def60-4c51-47b7-9fdd-24215dc451b2 tempest-ServerDiskConfigTestJSON-1562148127 tempest-ServerDiskConfigTestJSON-1562148127-project-member] Enqueued Resource ID: 5a45a455-673b-417d-b2f6-be9352c2077e with Priority: HIGHEST for action security_group_members [ 725.559749] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a45a455-673b-417d-b2f6-be9352c2077e with Priority: HIGHEST for action security_group_members [ 725.560168] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a45a455-673b-417d-b2f6-be9352c2077e taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.560308] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a45a455-673b-417d-b2f6-be9352c2077e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.560376] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a45a455-673b-417d-b2f6-be9352c2077e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.560603] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a45a455-673b-417d-b2f6-be9352c2077e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.561506] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.561506] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.561506] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.561758] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.561896] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.561999] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5a45a455-673b-417d-b2f6-be9352c2077e',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.598819] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 20ba03af-aba0-4fe6-af1e-ea103067fcbe in Status: SUCCESS [ 725.599092] env[69232]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 20ba03af-aba0-4fe6-af1e-ea103067fcbe deletion is rescheduled due to dependency. [ 725.599269] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-20ba03af-aba0-4fe6-af1e-ea103067fcbe" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.677030] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 256e29a3-9ff8-45a1-805b-591f83c2a8b4 in Status: SUCCESS [ 725.677030] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-256e29a3-9ff8-45a1-805b-591f83c2a8b4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.962236] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock network-846 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.962535] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "network-846" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.962724] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "network-846" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.963123] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "network-846" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.963395] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.963560] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.963701] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.964421] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.967839] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.967839] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 725.967839] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] NeedRegenerationException {{(pid=69232) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 725.967839] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] no value, waiting for create lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 725.967839] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] value creation lock acquired {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 725.967839] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 725.967839] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Calling creation function for not-yet-present value {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 725.967839] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 725.991124] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 725.991124] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=69232) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 725.991124] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Released creation lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 725.991124] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "network-846" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.991124] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock port-69461635-d343-4dc8-9437-7c6fe2471be0 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.991124] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "port-69461635-d343-4dc8-9437-7c6fe2471be0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.991124] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "port-69461635-d343-4dc8-9437-7c6fe2471be0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.991124] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "port-69461635-d343-4dc8-9437-7c6fe2471be0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.991124] env[69232]: DEBUG networking_nsxv3.api.rpc [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('69461635-d343-4dc8-9437-7c6fe2471be0',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.066009] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.066280] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.066280] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.066482] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.066579] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.066777] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.066881] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.066941] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.067116] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.067187] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.067261] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5a45a455-673b-417d-b2f6-be9352c2077e is going to be updated. [ 726.099823] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.100055] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.100126] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.100312] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.100494] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.116166] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a45a455-673b-417d-b2f6-be9352c2077e in Status: IN_PROGRESS for 2s [ 726.454109] env[69232]: INFO networking_nsxv3.common.synchronization [None req-c87c4b59-085b-4215-a2e5-9d574eef09d8 None None] Enqueued Resource ID: be428e1c-5b16-4ecf-a5a7-d68f0862eb39 with Priority: HIGHEST for action port [ 726.454751] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: be428e1c-5b16-4ecf-a5a7-d68f0862eb39 with Priority: HIGHEST for action port [ 726.455778] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-be428e1c-5b16-4ecf-a5a7-d68f0862eb39 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.455975] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-be428e1c-5b16-4ecf-a5a7-d68f0862eb39" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.456239] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-be428e1c-5b16-4ecf-a5a7-d68f0862eb39" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.456327] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-be428e1c-5b16-4ecf-a5a7-d68f0862eb39" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.457642] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('be428e1c-5b16-4ecf-a5a7-d68f0862eb39',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.496018] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.496018] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.496018] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.496018] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.496018] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.496018] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Segment Port 69461635-d343-4dc8-9437-7c6fe2471be0 not found, creating... [ 726.496018] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.496018] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.496466] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.496552] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.496698] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.497430] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.497570] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.497776] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.498088] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.498272] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.498497] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Resource: SegmentPort with ID: 69461635-d343-4dc8-9437-7c6fe2471be0 is going to be created. [ 726.533066] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.533066] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.533066] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.533066] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.533066] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.533066] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "port-69461635-d343-4dc8-9437-7c6fe2471be0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.561966] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: abd587ac-a2db-4962-b166-638ba1590646 in Status: SUCCESS [ 726.562279] env[69232]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: abd587ac-a2db-4962-b166-638ba1590646 deletion is rescheduled due to dependency. [ 726.562339] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-abd587ac-a2db-4962-b166-638ba1590646" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.959910] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port be428e1c-5b16-4ecf-a5a7-d68f0862eb39 [ 726.963523] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.963523] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.963523] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.963523] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.963523] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.963523] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:be428e1c-5b16-4ecf-a5a7-d68f0862eb39 already deleted. [ 726.963523] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-be428e1c-5b16-4ecf-a5a7-d68f0862eb39" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.289998] env[69232]: INFO networking_nsxv3.common.synchronization [req-0462986d-6c35-4710-ac4a-8211b25a424c req-fdf4aea0-9d88-485a-85d9-99923b096413 tempest-FloatingIPsAssociationTestJSON-136976334 tempest-FloatingIPsAssociationTestJSON-136976334-project-member] Enqueued Resource ID: 5435d71f-3832-4f11-be57-bef3011dd7b7 with Priority: HIGHEST for action security_group_members [ 727.290786] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5435d71f-3832-4f11-be57-bef3011dd7b7 with Priority: HIGHEST for action security_group_members [ 727.292746] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-5435d71f-3832-4f11-be57-bef3011dd7b7 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.292746] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5435d71f-3832-4f11-be57-bef3011dd7b7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.292746] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5435d71f-3832-4f11-be57-bef3011dd7b7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.292746] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5435d71f-3832-4f11-be57-bef3011dd7b7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.292746] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.293106] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.293106] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.293106] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.293106] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.293240] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5435d71f-3832-4f11-be57-bef3011dd7b7',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.298446] env[69232]: INFO networking_nsxv3.common.synchronization [req-49e1804b-ca82-42f0-a307-77db2cb8f5c4 req-2edbdb83-d1e0-4d36-bece-8cc9ea2e07fc service nova] Enqueued Resource ID: 5a45a455-673b-417d-b2f6-be9352c2077e with Priority: HIGHEST for action security_group_rules [ 727.298446] env[69232]: INFO networking_nsxv3.common.synchronization [req-49e1804b-ca82-42f0-a307-77db2cb8f5c4 req-2edbdb83-d1e0-4d36-bece-8cc9ea2e07fc service nova] Enqueued Resource ID: 5a45a455-673b-417d-b2f6-be9352c2077e with Priority: HIGHEST for action security_group_members [ 727.298666] env[69232]: INFO networking_nsxv3.common.synchronization [req-49e1804b-ca82-42f0-a307-77db2cb8f5c4 req-2edbdb83-d1e0-4d36-bece-8cc9ea2e07fc service nova] Enqueued Resource ID: 69461635-d343-4dc8-9437-7c6fe2471be0 with Priority: HIGHEST for action port [ 727.299143] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a45a455-673b-417d-b2f6-be9352c2077e with Priority: HIGHEST for action security_group_rules [ 727.299143] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a45a455-673b-417d-b2f6-be9352c2077e with Priority: HIGHEST for action security_group_members [ 727.299227] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69461635-d343-4dc8-9437-7c6fe2471be0 with Priority: HIGHEST for action port [ 727.300132] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5a45a455-673b-417d-b2f6-be9352c2077e taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.300258] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5a45a455-673b-417d-b2f6-be9352c2077e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.300327] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5a45a455-673b-417d-b2f6-be9352c2077e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.302057] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5a45a455-673b-417d-b2f6-be9352c2077e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.302057] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5a45a455-673b-417d-b2f6-be9352c2077e',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.303984] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a45a455-673b-417d-b2f6-be9352c2077e taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.303984] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a45a455-673b-417d-b2f6-be9352c2077e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.303984] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-69461635-d343-4dc8-9437-7c6fe2471be0 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.303984] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-69461635-d343-4dc8-9437-7c6fe2471be0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.303984] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-69461635-d343-4dc8-9437-7c6fe2471be0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.303984] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-69461635-d343-4dc8-9437-7c6fe2471be0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.303984] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('69461635-d343-4dc8-9437-7c6fe2471be0',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.797314] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.797596] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.797596] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.797754] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.797850] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.798049] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.798147] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.798210] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.798363] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.798440] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.798525] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5435d71f-3832-4f11-be57-bef3011dd7b7 is going to be updated. [ 727.809184] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a45a455-673b-417d-b2f6-be9352c2077e taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.809184] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a45a455-673b-417d-b2f6-be9352c2077e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.809184] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 69461635-d343-4dc8-9437-7c6fe2471be0 with status ACTIVE [ 727.809184] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.809184] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.809184] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.809184] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.809184] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.809184] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.809184] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.809184] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.809184] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.809789] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.809789] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.809789] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.809789] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.809789] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.810079] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.810079] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 69461635-d343-4dc8-9437-7c6fe2471be0 is going to be updated. [ 727.835646] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.835822] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.835863] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.836096] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.836234] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.837949] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.838838] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.838922] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.839160] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.839257] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.839425] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-69461635-d343-4dc8-9437-7c6fe2471be0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.852144] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5435d71f-3832-4f11-be57-bef3011dd7b7 in Status: IN_PROGRESS for 2s [ 727.927259] env[69232]: INFO networking_nsxv3.common.synchronization [req-ab639903-071f-482a-ab0c-ac3310494cef req-1847480b-c3c3-4ab7-bdc2-9ea53c809cdc tempest-VolumesAssistedSnapshotsTest-1395395803 tempest-VolumesAssistedSnapshotsTest-1395395803-project-member] Enqueued Resource ID: c042e2fd-851d-4970-9cfd-994d6fa3bc3a with Priority: HIGHEST for action security_group_members [ 727.927259] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c042e2fd-851d-4970-9cfd-994d6fa3bc3a with Priority: HIGHEST for action security_group_members [ 727.927259] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-c042e2fd-851d-4970-9cfd-994d6fa3bc3a taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.927259] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c042e2fd-851d-4970-9cfd-994d6fa3bc3a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.927259] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c042e2fd-851d-4970-9cfd-994d6fa3bc3a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.927259] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c042e2fd-851d-4970-9cfd-994d6fa3bc3a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.928563] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.930172] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.930172] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.930172] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.930172] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.930643] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c042e2fd-851d-4970-9cfd-994d6fa3bc3a',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.953684] env[69232]: INFO networking_nsxv3.common.synchronization [req-fbf35d32-1977-4343-a004-055676527a6d req-99a87823-dcb3-41e7-967d-d82dee0e1409 tempest-AttachInterfacesTestJSON-1442903876 tempest-AttachInterfacesTestJSON-1442903876-project-member] Enqueued Resource ID: 36cbe3ea-321a-4c5f-b46b-f3297d4ccb49 with Priority: HIGHEST for action security_group_members [ 727.954209] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 36cbe3ea-321a-4c5f-b46b-f3297d4ccb49 with Priority: HIGHEST for action security_group_members [ 727.954504] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-36cbe3ea-321a-4c5f-b46b-f3297d4ccb49 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.954628] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-36cbe3ea-321a-4c5f-b46b-f3297d4ccb49" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.954685] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-36cbe3ea-321a-4c5f-b46b-f3297d4ccb49" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.954869] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-36cbe3ea-321a-4c5f-b46b-f3297d4ccb49" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.956506] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.956644] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.956716] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.956904] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.956992] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.957120] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('36cbe3ea-321a-4c5f-b46b-f3297d4ccb49',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.134455] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a45a455-673b-417d-b2f6-be9352c2077e in Status: SUCCESS [ 728.137019] env[69232]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5a45a455-673b-417d-b2f6-be9352c2077e deletion is rescheduled due to dependency. [ 728.137019] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a45a455-673b-417d-b2f6-be9352c2077e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.137019] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a45a455-673b-417d-b2f6-be9352c2077e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.137019] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a45a455-673b-417d-b2f6-be9352c2077e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.137019] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.137019] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.137019] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.137019] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.137019] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.137019] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5a45a455-673b-417d-b2f6-be9352c2077e',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.436129] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.436129] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.436239] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.436471] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.436751] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.436941] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.437102] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.437276] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.437340] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.437454] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.437637] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c042e2fd-851d-4970-9cfd-994d6fa3bc3a is going to be updated. [ 728.459519] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.459690] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.459940] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.460164] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.460816] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.460816] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.460816] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.460816] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.460816] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.461075] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.461075] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 36cbe3ea-321a-4c5f-b46b-f3297d4ccb49 is going to be updated. [ 728.473448] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.473597] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.473668] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.473881] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.474032] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.486264] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c042e2fd-851d-4970-9cfd-994d6fa3bc3a in Status: IN_PROGRESS for 2s [ 728.498801] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.499161] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.499161] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.499337] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.499441] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.509980] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 36cbe3ea-321a-4c5f-b46b-f3297d4ccb49 in Status: IN_PROGRESS for 2s [ 728.640605] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5a45a455-673b-417d-b2f6-be9352c2077e',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.146625] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5a45a455-673b-417d-b2f6-be9352c2077e',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.652464] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.652669] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.652726] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.653442] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.653442] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.653442] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5a45a455-673b-417d-b2f6-be9352c2077e is going to be updated. [ 729.717668] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.717817] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.717885] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.718128] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.718277] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.727598] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a45a455-673b-417d-b2f6-be9352c2077e in Status: IN_PROGRESS for 2s [ 729.865742] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5435d71f-3832-4f11-be57-bef3011dd7b7 in Status: SUCCESS [ 729.865998] env[69232]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5435d71f-3832-4f11-be57-bef3011dd7b7 deletion is rescheduled due to dependency. [ 729.865998] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5435d71f-3832-4f11-be57-bef3011dd7b7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.495949] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c042e2fd-851d-4970-9cfd-994d6fa3bc3a in Status: SUCCESS [ 730.496233] env[69232]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c042e2fd-851d-4970-9cfd-994d6fa3bc3a deletion is rescheduled due to dependency. [ 730.496381] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c042e2fd-851d-4970-9cfd-994d6fa3bc3a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.519706] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 36cbe3ea-321a-4c5f-b46b-f3297d4ccb49 in Status: SUCCESS [ 730.519706] env[69232]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 36cbe3ea-321a-4c5f-b46b-f3297d4ccb49 deletion is rescheduled due to dependency. [ 730.519706] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-36cbe3ea-321a-4c5f-b46b-f3297d4ccb49" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.699378] env[69232]: INFO networking_nsxv3.common.synchronization [req-e914678e-cb77-49f5-b89a-0610020b9b26 req-91e70b80-4fc8-430f-af27-e419ab2f5d90 tempest-ServersTestMultiNic-1112914223 tempest-ServersTestMultiNic-1112914223-project-member] Enqueued Resource ID: 5e155778-3c23-43f6-a632-21f66a4311f8 with Priority: HIGHEST for action security_group_members [ 730.699952] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e155778-3c23-43f6-a632-21f66a4311f8 with Priority: HIGHEST for action security_group_members [ 730.704009] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e155778-3c23-43f6-a632-21f66a4311f8 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.704009] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e155778-3c23-43f6-a632-21f66a4311f8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.704009] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e155778-3c23-43f6-a632-21f66a4311f8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.704009] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e155778-3c23-43f6-a632-21f66a4311f8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.704009] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.704009] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.704009] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.704009] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.704009] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.704009] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5e155778-3c23-43f6-a632-21f66a4311f8',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.205867] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.207046] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.207046] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.207046] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.207046] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.207046] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.207046] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.207046] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.207046] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.207046] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.207046] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e155778-3c23-43f6-a632-21f66a4311f8 already deleted. [ 731.207531] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e155778-3c23-43f6-a632-21f66a4311f8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.423269] env[69232]: INFO networking_nsxv3.common.synchronization [req-e914678e-cb77-49f5-b89a-0610020b9b26 req-c091f037-47eb-4c8b-89d0-c3d5c1b15b6d tempest-ServersTestMultiNic-1112914223 tempest-ServersTestMultiNic-1112914223-project-member] Enqueued Resource ID: 5e155778-3c23-43f6-a632-21f66a4311f8 with Priority: HIGHEST for action security_group_members [ 731.423828] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e155778-3c23-43f6-a632-21f66a4311f8 with Priority: HIGHEST for action security_group_members [ 731.424129] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e155778-3c23-43f6-a632-21f66a4311f8 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.424252] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e155778-3c23-43f6-a632-21f66a4311f8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.424351] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e155778-3c23-43f6-a632-21f66a4311f8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.424517] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e155778-3c23-43f6-a632-21f66a4311f8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.427062] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.427062] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.427062] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.427062] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.427062] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.427062] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5e155778-3c23-43f6-a632-21f66a4311f8',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.739041] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a45a455-673b-417d-b2f6-be9352c2077e in Status: SUCCESS [ 731.739340] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a45a455-673b-417d-b2f6-be9352c2077e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.740594] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a45a455-673b-417d-b2f6-be9352c2077e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.740594] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a45a455-673b-417d-b2f6-be9352c2077e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.740594] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.740594] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.740594] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.740594] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.740594] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.740594] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a45a455-673b-417d-b2f6-be9352c2077e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.740594] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5a45a455-673b-417d-b2f6-be9352c2077e',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.928392] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.929455] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.929455] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.929455] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.929455] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.929455] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.929871] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.929871] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.929871] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.929965] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.930059] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e155778-3c23-43f6-a632-21f66a4311f8 already deleted. [ 731.930128] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e155778-3c23-43f6-a632-21f66a4311f8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.981430] env[69232]: INFO networking_nsxv3.common.synchronization [req-e914678e-cb77-49f5-b89a-0610020b9b26 req-af6e2eea-d125-43fd-816a-8291a4bf7437 tempest-ServersTestMultiNic-1112914223 tempest-ServersTestMultiNic-1112914223-project-member] Enqueued Resource ID: 5e155778-3c23-43f6-a632-21f66a4311f8 with Priority: HIGHEST for action security_group_members [ 731.982165] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e155778-3c23-43f6-a632-21f66a4311f8 with Priority: HIGHEST for action security_group_members [ 731.982492] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e155778-3c23-43f6-a632-21f66a4311f8 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.982856] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e155778-3c23-43f6-a632-21f66a4311f8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.982856] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e155778-3c23-43f6-a632-21f66a4311f8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.983038] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e155778-3c23-43f6-a632-21f66a4311f8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.983716] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.983716] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.983716] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.983716] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.984044] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.984044] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5e155778-3c23-43f6-a632-21f66a4311f8',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.243248] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a45a455-673b-417d-b2f6-be9352c2077e taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.243470] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a45a455-673b-417d-b2f6-be9352c2077e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.243580] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a45a455-673b-417d-b2f6-be9352c2077e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.243994] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a45a455-673b-417d-b2f6-be9352c2077e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.244242] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.244345] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.244448] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.244731] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.244874] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.244972] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a45a455-673b-417d-b2f6-be9352c2077e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.245149] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a45a455-673b-417d-b2f6-be9352c2077e taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.245245] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a45a455-673b-417d-b2f6-be9352c2077e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.245307] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a45a455-673b-417d-b2f6-be9352c2077e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.245463] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a45a455-673b-417d-b2f6-be9352c2077e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.245601] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.245692] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.245757] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.245895] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.245974] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.246078] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a45a455-673b-417d-b2f6-be9352c2077e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.246176] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5a45a455-673b-417d-b2f6-be9352c2077e',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.427075] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock network-467 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.427275] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "network-467" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.427394] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "network-467" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.427898] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "network-467" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.428695] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.428806] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.428914] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.429581] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.429816] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.430404] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 732.430404] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] NeedRegenerationException {{(pid=69232) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 732.430404] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] no value, waiting for create lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 732.430814] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] value creation lock acquired {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 732.430814] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 732.430814] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Calling creation function for not-yet-present value {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 732.430948] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 732.452413] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 732.452588] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69232) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 732.452779] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Released creation lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 732.453108] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "network-467" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.453414] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock port-89f3df2c-21c4-4d19-b645-d9c6af157fd6 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.453627] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "port-89f3df2c-21c4-4d19-b645-d9c6af157fd6" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.453787] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "port-89f3df2c-21c4-4d19-b645-d9c6af157fd6" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.454154] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "port-89f3df2c-21c4-4d19-b645-d9c6af157fd6" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.454335] env[69232]: DEBUG networking_nsxv3.api.rpc [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('89f3df2c-21c4-4d19-b645-d9c6af157fd6',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.488199] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.488199] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.488199] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.488199] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.488199] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.488199] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.488199] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.488199] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.488199] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.488199] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.488199] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e155778-3c23-43f6-a632-21f66a4311f8 already deleted. [ 732.488199] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e155778-3c23-43f6-a632-21f66a4311f8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.748578] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5a45a455-673b-417d-b2f6-be9352c2077e: rpc.has_security_group_logging(os_id): False [ 732.771108] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.771329] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.771414] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.771882] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.771882] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.771882] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.772075] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.772075] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.772350] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.772350] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.772490] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.772490] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.772559] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.772690] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.772754] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.772975] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.773068] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.773285] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.773409] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.773462] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.773550] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5a45a455-673b-417d-b2f6-be9352c2077e is going to be updated. [ 732.847761] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.848266] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.848473] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.849408] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.849408] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.870188] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5a45a455-673b-417d-b2f6-be9352c2077e in Status: IN_PROGRESS for 2s [ 732.957073] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.957241] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.957827] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.957827] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.958129] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.958129] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Segment Port 89f3df2c-21c4-4d19-b645-d9c6af157fd6 not found, creating... [ 732.958599] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.958599] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.958599] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.958812] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.958950] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.959411] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.960366] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.960366] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.960366] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.960366] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.960366] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Resource: SegmentPort with ID: 89f3df2c-21c4-4d19-b645-d9c6af157fd6 is going to be created. [ 732.982925] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.983181] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.983308] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.984049] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.984286] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.984531] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "port-89f3df2c-21c4-4d19-b645-d9c6af157fd6" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.122911] env[69232]: INFO networking_nsxv3.common.synchronization [None req-5f5710f2-0e76-44af-bf12-846922b0efc5 tempest-ServerRescueNegativeTestJSON-737130981 tempest-ServerRescueNegativeTestJSON-737130981-project-member] Enqueued Resource ID: f29e46f4-baa2-4512-b89f-bb8fa2c53157 with Priority: HIGHEST for action security_group_rules [ 733.124281] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f29e46f4-baa2-4512-b89f-bb8fa2c53157 with Priority: HIGHEST for action security_group_rules [ 733.126863] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f29e46f4-baa2-4512-b89f-bb8fa2c53157 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.127476] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f29e46f4-baa2-4512-b89f-bb8fa2c53157" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.128280] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f29e46f4-baa2-4512-b89f-bb8fa2c53157" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.128429] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f29e46f4-baa2-4512-b89f-bb8fa2c53157" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.129575] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f29e46f4-baa2-4512-b89f-bb8fa2c53157',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.244262] env[69232]: INFO networking_nsxv3.common.synchronization [None req-9637a693-0e63-41e5-a04f-5732428cb2e7 tempest-ServerRescueNegativeTestJSON-737130981 tempest-ServerRescueNegativeTestJSON-737130981-project-member] Enqueued Resource ID: f29e46f4-baa2-4512-b89f-bb8fa2c53157 with Priority: HIGHEST for action security_group_rules [ 733.244262] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f29e46f4-baa2-4512-b89f-bb8fa2c53157 with Priority: HIGHEST for action security_group_rules [ 733.244262] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f29e46f4-baa2-4512-b89f-bb8fa2c53157 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.244705] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f29e46f4-baa2-4512-b89f-bb8fa2c53157" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.653539] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.653539] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.653539] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.653539] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.653539] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.653539] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f29e46f4-baa2-4512-b89f-bb8fa2c53157 already deleted. [ 733.653539] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f29e46f4-baa2-4512-b89f-bb8fa2c53157" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.653539] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f29e46f4-baa2-4512-b89f-bb8fa2c53157" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.654121] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f29e46f4-baa2-4512-b89f-bb8fa2c53157" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.654121] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f29e46f4-baa2-4512-b89f-bb8fa2c53157',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.903632] env[69232]: INFO networking_nsxv3.common.synchronization [req-e914678e-cb77-49f5-b89a-0610020b9b26 req-c2067b30-6729-44ff-9841-7b28adc308bc service nova] Enqueued Resource ID: 5e155778-3c23-43f6-a632-21f66a4311f8 with Priority: HIGHEST for action security_group_rules [ 733.903632] env[69232]: INFO networking_nsxv3.common.synchronization [req-e914678e-cb77-49f5-b89a-0610020b9b26 req-c2067b30-6729-44ff-9841-7b28adc308bc service nova] Enqueued Resource ID: 5e155778-3c23-43f6-a632-21f66a4311f8 with Priority: HIGHEST for action security_group_members [ 733.903632] env[69232]: INFO networking_nsxv3.common.synchronization [req-e914678e-cb77-49f5-b89a-0610020b9b26 req-c2067b30-6729-44ff-9841-7b28adc308bc service nova] Enqueued Resource ID: 89f3df2c-21c4-4d19-b645-d9c6af157fd6 with Priority: HIGHEST for action port [ 733.903632] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e155778-3c23-43f6-a632-21f66a4311f8 with Priority: HIGHEST for action security_group_rules [ 733.903632] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e155778-3c23-43f6-a632-21f66a4311f8 with Priority: HIGHEST for action security_group_members [ 733.903632] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 89f3df2c-21c4-4d19-b645-d9c6af157fd6 with Priority: HIGHEST for action port [ 733.903632] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5e155778-3c23-43f6-a632-21f66a4311f8 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.903632] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5e155778-3c23-43f6-a632-21f66a4311f8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.903632] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5e155778-3c23-43f6-a632-21f66a4311f8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.904513] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5e155778-3c23-43f6-a632-21f66a4311f8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.904513] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5e155778-3c23-43f6-a632-21f66a4311f8',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.905305] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e155778-3c23-43f6-a632-21f66a4311f8 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.905480] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e155778-3c23-43f6-a632-21f66a4311f8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.905602] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e155778-3c23-43f6-a632-21f66a4311f8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.905871] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e155778-3c23-43f6-a632-21f66a4311f8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.906063] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.906302] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.906392] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.906571] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.906677] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.906775] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5e155778-3c23-43f6-a632-21f66a4311f8',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.907749] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-89f3df2c-21c4-4d19-b645-d9c6af157fd6 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.910804] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-89f3df2c-21c4-4d19-b645-d9c6af157fd6" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.910804] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-89f3df2c-21c4-4d19-b645-d9c6af157fd6" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.910804] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-89f3df2c-21c4-4d19-b645-d9c6af157fd6" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.910804] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('89f3df2c-21c4-4d19-b645-d9c6af157fd6',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.178937] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.179164] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.179254] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.179471] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.179565] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.179713] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f29e46f4-baa2-4512-b89f-bb8fa2c53157 already deleted. [ 734.179810] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f29e46f4-baa2-4512-b89f-bb8fa2c53157" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.411562] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5e155778-3c23-43f6-a632-21f66a4311f8',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.412903] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e155778-3c23-43f6-a632-21f66a4311f8 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.412903] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e155778-3c23-43f6-a632-21f66a4311f8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.412903] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 89f3df2c-21c4-4d19-b645-d9c6af157fd6 with status ACTIVE [ 734.413109] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.413173] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.413209] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.413389] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.413472] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.413639] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.413746] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.413806] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.413961] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.414048] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.414221] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.414329] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.414390] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.414530] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.414633] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.414724] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 89f3df2c-21c4-4d19-b645-d9c6af157fd6 is going to be updated. [ 734.442084] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.442329] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.442460] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.442722] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.442924] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.443149] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-89f3df2c-21c4-4d19-b645-d9c6af157fd6" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.845836] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock network-566 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.845836] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "network-566" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.845836] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "network-566" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.845836] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "network-566" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.846219] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.846429] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.846552] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.846869] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.847112] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.847368] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 734.847520] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] NeedRegenerationException {{(pid=69232) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 734.847656] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] no value, waiting for create lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 734.847860] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] value creation lock acquired {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 734.848021] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 734.848210] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Calling creation function for not-yet-present value {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 734.848372] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 734.879025] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 734.879025] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Cache value generated in 0.031 seconds for key(s): 'zone-id' {{(pid=69232) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 734.879231] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Released creation lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 734.879476] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "network-566" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.879870] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock port-c3b4efd9-ec53-4be9-9d82-ee3b019bd5c5 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.880139] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "port-c3b4efd9-ec53-4be9-9d82-ee3b019bd5c5" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.880139] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "port-c3b4efd9-ec53-4be9-9d82-ee3b019bd5c5" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.880604] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "port-c3b4efd9-ec53-4be9-9d82-ee3b019bd5c5" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.880797] env[69232]: DEBUG networking_nsxv3.api.rpc [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c3b4efd9-ec53-4be9-9d82-ee3b019bd5c5',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.893053] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5a45a455-673b-417d-b2f6-be9352c2077e in Status: SUCCESS [ 734.893779] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5a45a455-673b-417d-b2f6-be9352c2077e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.917409] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5e155778-3c23-43f6-a632-21f66a4311f8',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.385219] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.385401] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.385516] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.385789] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.385945] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.386110] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Segment Port c3b4efd9-ec53-4be9-9d82-ee3b019bd5c5 not found, creating... [ 735.386376] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.386530] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.386645] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.386863] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.386999] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.387324] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.387514] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.387658] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.387885] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.388102] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.388215] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Resource: SegmentPort with ID: c3b4efd9-ec53-4be9-9d82-ee3b019bd5c5 is going to be created. [ 735.410402] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.410758] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.410911] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.411342] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.411675] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.411845] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "port-c3b4efd9-ec53-4be9-9d82-ee3b019bd5c5" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.420232] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.420450] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.420639] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.420809] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.420994] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.421147] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e155778-3c23-43f6-a632-21f66a4311f8 is going to be created. [ 735.450022] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.450022] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.450022] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.450022] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.450022] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.462565] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e155778-3c23-43f6-a632-21f66a4311f8 in Status: UNINITIALIZED for 2s [ 735.519242] env[69232]: INFO networking_nsxv3.common.synchronization [req-f4f4a4a0-96e9-4753-be96-40b9cf5c05f0 req-2ea74e5f-4fd6-45ba-a98a-29cb6fdc7921 tempest-ListImageFiltersTestJSON-1520270285 tempest-ListImageFiltersTestJSON-1520270285-project-member] Enqueued Resource ID: dcd9f79f-c997-4a2d-83a2-472c849b1794 with Priority: HIGHEST for action security_group_members [ 735.519843] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dcd9f79f-c997-4a2d-83a2-472c849b1794 with Priority: HIGHEST for action security_group_members [ 735.520263] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-dcd9f79f-c997-4a2d-83a2-472c849b1794 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.520395] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dcd9f79f-c997-4a2d-83a2-472c849b1794" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.520464] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dcd9f79f-c997-4a2d-83a2-472c849b1794" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.520674] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dcd9f79f-c997-4a2d-83a2-472c849b1794" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.520873] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.521012] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.521097] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.521284] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.521436] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.521550] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dcd9f79f-c997-4a2d-83a2-472c849b1794',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.024912] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dcd9f79f-c997-4a2d-83a2-472c849b1794',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.228676] env[69232]: INFO networking_nsxv3.common.synchronization [req-e914678e-cb77-49f5-b89a-0610020b9b26 req-06ce6677-72af-429b-b639-6fb8d07eb314 service nova] Enqueued Resource ID: 5e155778-3c23-43f6-a632-21f66a4311f8 with Priority: HIGHEST for action security_group_rules [ 736.228867] env[69232]: INFO networking_nsxv3.common.synchronization [req-e914678e-cb77-49f5-b89a-0610020b9b26 req-06ce6677-72af-429b-b639-6fb8d07eb314 service nova] Enqueued Resource ID: 5e155778-3c23-43f6-a632-21f66a4311f8 with Priority: HIGHEST for action security_group_members [ 736.229020] env[69232]: INFO networking_nsxv3.common.synchronization [req-e914678e-cb77-49f5-b89a-0610020b9b26 req-06ce6677-72af-429b-b639-6fb8d07eb314 service nova] Enqueued Resource ID: c3b4efd9-ec53-4be9-9d82-ee3b019bd5c5 with Priority: HIGHEST for action port [ 736.229558] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e155778-3c23-43f6-a632-21f66a4311f8 with Priority: HIGHEST for action security_group_rules [ 736.229716] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e155778-3c23-43f6-a632-21f66a4311f8 with Priority: HIGHEST for action security_group_members [ 736.229904] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3b4efd9-ec53-4be9-9d82-ee3b019bd5c5 with Priority: HIGHEST for action port [ 736.230255] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5e155778-3c23-43f6-a632-21f66a4311f8 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.230372] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5e155778-3c23-43f6-a632-21f66a4311f8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.230628] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e155778-3c23-43f6-a632-21f66a4311f8 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.230797] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e155778-3c23-43f6-a632-21f66a4311f8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.231039] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-c3b4efd9-ec53-4be9-9d82-ee3b019bd5c5 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.231188] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c3b4efd9-ec53-4be9-9d82-ee3b019bd5c5" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.231278] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c3b4efd9-ec53-4be9-9d82-ee3b019bd5c5" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.231642] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c3b4efd9-ec53-4be9-9d82-ee3b019bd5c5" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.231810] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c3b4efd9-ec53-4be9-9d82-ee3b019bd5c5',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.527037] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dcd9f79f-c997-4a2d-83a2-472c849b1794',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.734590] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c3b4efd9-ec53-4be9-9d82-ee3b019bd5c5 with status ACTIVE [ 736.734892] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.735070] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.735216] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.735426] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.735774] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.735774] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.735913] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.736037] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.736237] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.736325] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.736514] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.736613] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.736676] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.736822] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.736897] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.736980] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c3b4efd9-ec53-4be9-9d82-ee3b019bd5c5 is going to be updated. [ 736.762230] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.762321] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.762321] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.762569] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.762755] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.762942] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c3b4efd9-ec53-4be9-9d82-ee3b019bd5c5" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.029852] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.030272] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.030272] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.034023] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.034023] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.034023] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dcd9f79f-c997-4a2d-83a2-472c849b1794 is going to be updated. [ 737.065876] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.066027] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.066103] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.069278] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.069278] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.076367] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dcd9f79f-c997-4a2d-83a2-472c849b1794 in Status: IN_PROGRESS for 2s [ 737.248425] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock network-467 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.248625] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "network-467" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.248749] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "network-467" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.249021] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "network-467" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.249275] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.249432] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.249547] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.249795] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.249995] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.250450] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 737.250589] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] NeedRegenerationException {{(pid=69232) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 737.250842] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] no value, waiting for create lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 737.250842] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] value creation lock acquired {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 737.251011] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 737.251150] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Calling creation function for not-yet-present value {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 737.251357] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 737.277509] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 737.277509] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=69232) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 737.277509] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Released creation lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 737.277878] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "network-467" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.278037] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock port-8de8956d-2924-488f-8a47-c25918a0dd14 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.278274] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "port-8de8956d-2924-488f-8a47-c25918a0dd14" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.278468] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "port-8de8956d-2924-488f-8a47-c25918a0dd14" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.278893] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "port-8de8956d-2924-488f-8a47-c25918a0dd14" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.278954] env[69232]: DEBUG networking_nsxv3.api.rpc [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8de8956d-2924-488f-8a47-c25918a0dd14',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.475441] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e155778-3c23-43f6-a632-21f66a4311f8 in Status: SUCCESS [ 737.475441] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e155778-3c23-43f6-a632-21f66a4311f8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.476475] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e155778-3c23-43f6-a632-21f66a4311f8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.476475] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e155778-3c23-43f6-a632-21f66a4311f8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.476475] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.476475] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.476475] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.476475] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.476475] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.476732] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e155778-3c23-43f6-a632-21f66a4311f8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.476732] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5e155778-3c23-43f6-a632-21f66a4311f8',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.477608] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e155778-3c23-43f6-a632-21f66a4311f8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.477810] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e155778-3c23-43f6-a632-21f66a4311f8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.478079] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.478208] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.478265] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.478540] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.478629] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.478744] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5e155778-3c23-43f6-a632-21f66a4311f8',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.781690] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.781954] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.782323] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.782848] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.783206] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.783499] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Segment Port 8de8956d-2924-488f-8a47-c25918a0dd14 not found, creating... [ 737.784323] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.784509] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.784645] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.784901] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.785078] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.785400] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.785566] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.785701] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.786013] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.786268] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.786501] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Resource: SegmentPort with ID: 8de8956d-2924-488f-8a47-c25918a0dd14 is going to be created. [ 737.810993] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.811222] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.811346] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.811621] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.811843] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.812122] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "port-8de8956d-2924-488f-8a47-c25918a0dd14" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.982601] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e155778-3c23-43f6-a632-21f66a4311f8 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.982601] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e155778-3c23-43f6-a632-21f66a4311f8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.982601] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5e155778-3c23-43f6-a632-21f66a4311f8',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.278681] env[69232]: INFO networking_nsxv3.common.synchronization [req-e9b44cf2-2d6a-4088-a7b8-72e2800c493e req-16016161-b2d8-4950-8e13-569200ca0d4a tempest-ImagesOneServerNegativeTestJSON-501782696 tempest-ImagesOneServerNegativeTestJSON-501782696-project-member] Enqueued Resource ID: 6e7bf0fa-24cf-40f7-ac38-1adabda5207c with Priority: HIGHEST for action security_group_members [ 738.279569] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e7bf0fa-24cf-40f7-ac38-1adabda5207c with Priority: HIGHEST for action security_group_members [ 738.279787] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e7bf0fa-24cf-40f7-ac38-1adabda5207c taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.279926] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e7bf0fa-24cf-40f7-ac38-1adabda5207c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.279926] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e7bf0fa-24cf-40f7-ac38-1adabda5207c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.281311] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e7bf0fa-24cf-40f7-ac38-1adabda5207c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.281506] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.281621] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.281682] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.282652] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.282652] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.282652] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6e7bf0fa-24cf-40f7-ac38-1adabda5207c',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.485412] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5e155778-3c23-43f6-a632-21f66a4311f8',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.648138] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock network-821 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.648138] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "network-821" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.648138] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "network-821" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.648138] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "network-821" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.648138] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.648138] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.648138] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.649062] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.649372] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.649775] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 738.650029] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] NeedRegenerationException {{(pid=69232) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 738.650260] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] no value, waiting for create lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 738.650538] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] value creation lock acquired {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 738.650874] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 738.651189] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Calling creation function for not-yet-present value {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 738.651443] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 738.675172] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 738.675172] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69232) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 738.675172] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Released creation lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 738.675172] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "network-821" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.675172] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock port-4e5e7e06-72d1-4094-a9b6-aca5f6b4f8e7 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.675172] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "port-4e5e7e06-72d1-4094-a9b6-aca5f6b4f8e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.675172] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "port-4e5e7e06-72d1-4094-a9b6-aca5f6b4f8e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.675172] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "port-4e5e7e06-72d1-4094-a9b6-aca5f6b4f8e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.675172] env[69232]: DEBUG networking_nsxv3.api.rpc [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4e5e7e06-72d1-4094-a9b6-aca5f6b4f8e7',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.788351] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.788529] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.788571] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.788769] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.789015] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.789359] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.789508] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.789611] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.789909] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.790043] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.790314] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e7bf0fa-24cf-40f7-ac38-1adabda5207c already deleted. [ 738.790314] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e7bf0fa-24cf-40f7-ac38-1adabda5207c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.857227] env[69232]: INFO networking_nsxv3.common.synchronization [req-e914678e-cb77-49f5-b89a-0610020b9b26 req-3fa0a453-a520-423a-97a2-72bbe121f4be service nova] Enqueued Resource ID: 5e155778-3c23-43f6-a632-21f66a4311f8 with Priority: HIGHEST for action security_group_rules [ 738.857956] env[69232]: INFO networking_nsxv3.common.synchronization [req-e914678e-cb77-49f5-b89a-0610020b9b26 req-3fa0a453-a520-423a-97a2-72bbe121f4be service nova] Enqueued Resource ID: 5e155778-3c23-43f6-a632-21f66a4311f8 with Priority: HIGHEST for action security_group_members [ 738.858252] env[69232]: INFO networking_nsxv3.common.synchronization [req-e914678e-cb77-49f5-b89a-0610020b9b26 req-3fa0a453-a520-423a-97a2-72bbe121f4be service nova] Enqueued Resource ID: 8de8956d-2924-488f-8a47-c25918a0dd14 with Priority: HIGHEST for action port [ 738.862022] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e155778-3c23-43f6-a632-21f66a4311f8 with Priority: HIGHEST for action security_group_rules [ 738.862022] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e155778-3c23-43f6-a632-21f66a4311f8 with Priority: HIGHEST for action security_group_members [ 738.862022] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8de8956d-2924-488f-8a47-c25918a0dd14 with Priority: HIGHEST for action port [ 738.862022] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5e155778-3c23-43f6-a632-21f66a4311f8 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.862022] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5e155778-3c23-43f6-a632-21f66a4311f8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.862022] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e155778-3c23-43f6-a632-21f66a4311f8 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.862022] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e155778-3c23-43f6-a632-21f66a4311f8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.862022] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-8de8956d-2924-488f-8a47-c25918a0dd14 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.862022] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8de8956d-2924-488f-8a47-c25918a0dd14" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.862022] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8de8956d-2924-488f-8a47-c25918a0dd14" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.862022] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8de8956d-2924-488f-8a47-c25918a0dd14" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.862022] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8de8956d-2924-488f-8a47-c25918a0dd14',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.990630] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.990865] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.990865] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.991117] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.991267] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.991377] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e155778-3c23-43f6-a632-21f66a4311f8 is going to be updated. [ 739.023255] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.026762] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.027310] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.027310] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.027310] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.039255] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e155778-3c23-43f6-a632-21f66a4311f8 in Status: IN_PROGRESS for 2s [ 739.086150] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dcd9f79f-c997-4a2d-83a2-472c849b1794 in Status: SUCCESS [ 739.086377] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dcd9f79f-c997-4a2d-83a2-472c849b1794" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.184409] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.184409] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.184409] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.184409] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.184409] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.184409] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Segment Port 4e5e7e06-72d1-4094-a9b6-aca5f6b4f8e7 not found, creating... [ 739.184409] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.191040] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.191040] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.191040] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.191040] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.191040] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.191040] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.191040] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.191040] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.191040] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.191040] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Resource: SegmentPort with ID: 4e5e7e06-72d1-4094-a9b6-aca5f6b4f8e7 is going to be created. [ 739.223890] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.224155] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.224282] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.224605] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.224873] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.225198] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "port-4e5e7e06-72d1-4094-a9b6-aca5f6b4f8e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.364168] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8de8956d-2924-488f-8a47-c25918a0dd14 with status ACTIVE [ 739.364533] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.364657] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.364740] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.365387] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.365387] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.365387] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.365387] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.365638] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.365638] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.365638] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.365962] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.365962] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.365962] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.366329] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.366329] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.366485] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8de8956d-2924-488f-8a47-c25918a0dd14 is going to be updated. [ 739.397152] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.397331] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.397499] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.397760] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.397926] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.398941] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8de8956d-2924-488f-8a47-c25918a0dd14" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.006183] env[69232]: INFO networking_nsxv3.common.synchronization [req-e9b44cf2-2d6a-4088-a7b8-72e2800c493e req-c5ad3c46-db9f-4fbf-82cb-be6f24f7eea9 service nova] Enqueued Resource ID: 6e7bf0fa-24cf-40f7-ac38-1adabda5207c with Priority: HIGHEST for action security_group_rules [ 740.006447] env[69232]: INFO networking_nsxv3.common.synchronization [req-e9b44cf2-2d6a-4088-a7b8-72e2800c493e req-c5ad3c46-db9f-4fbf-82cb-be6f24f7eea9 service nova] Enqueued Resource ID: 6e7bf0fa-24cf-40f7-ac38-1adabda5207c with Priority: HIGHEST for action security_group_members [ 740.006628] env[69232]: INFO networking_nsxv3.common.synchronization [req-e9b44cf2-2d6a-4088-a7b8-72e2800c493e req-c5ad3c46-db9f-4fbf-82cb-be6f24f7eea9 service nova] Enqueued Resource ID: 4e5e7e06-72d1-4094-a9b6-aca5f6b4f8e7 with Priority: HIGHEST for action port [ 740.007220] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e7bf0fa-24cf-40f7-ac38-1adabda5207c with Priority: HIGHEST for action security_group_rules [ 740.007551] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e7bf0fa-24cf-40f7-ac38-1adabda5207c with Priority: HIGHEST for action security_group_members [ 740.007736] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e5e7e06-72d1-4094-a9b6-aca5f6b4f8e7 with Priority: HIGHEST for action port [ 740.008066] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6e7bf0fa-24cf-40f7-ac38-1adabda5207c taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.008941] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6e7bf0fa-24cf-40f7-ac38-1adabda5207c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.008941] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6e7bf0fa-24cf-40f7-ac38-1adabda5207c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.008941] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6e7bf0fa-24cf-40f7-ac38-1adabda5207c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.008941] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6e7bf0fa-24cf-40f7-ac38-1adabda5207c',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.009549] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e7bf0fa-24cf-40f7-ac38-1adabda5207c taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.009664] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e7bf0fa-24cf-40f7-ac38-1adabda5207c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.009851] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e7bf0fa-24cf-40f7-ac38-1adabda5207c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.010261] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e7bf0fa-24cf-40f7-ac38-1adabda5207c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.010430] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.010535] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.010606] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.010810] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.010905] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.011075] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6e7bf0fa-24cf-40f7-ac38-1adabda5207c',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.011847] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-4e5e7e06-72d1-4094-a9b6-aca5f6b4f8e7 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.011954] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4e5e7e06-72d1-4094-a9b6-aca5f6b4f8e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.012028] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4e5e7e06-72d1-4094-a9b6-aca5f6b4f8e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.012219] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4e5e7e06-72d1-4094-a9b6-aca5f6b4f8e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.012325] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4e5e7e06-72d1-4094-a9b6-aca5f6b4f8e7',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.514283] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e7bf0fa-24cf-40f7-ac38-1adabda5207c taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.514707] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e7bf0fa-24cf-40f7-ac38-1adabda5207c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.514707] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6e7bf0fa-24cf-40f7-ac38-1adabda5207c',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.515574] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4e5e7e06-72d1-4094-a9b6-aca5f6b4f8e7 with status ACTIVE [ 740.515755] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.515876] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.515983] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.516171] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.516267] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.516444] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.516547] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.516609] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.516761] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.516841] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.517144] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.517697] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.517793] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.517912] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.517959] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.518072] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4e5e7e06-72d1-4094-a9b6-aca5f6b4f8e7 is going to be updated. [ 740.541364] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.541535] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.541635] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.541877] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.542284] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.542284] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4e5e7e06-72d1-4094-a9b6-aca5f6b4f8e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.020161] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6e7bf0fa-24cf-40f7-ac38-1adabda5207c',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.052249] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e155778-3c23-43f6-a632-21f66a4311f8 in Status: SUCCESS [ 741.052477] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e155778-3c23-43f6-a632-21f66a4311f8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.052990] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e155778-3c23-43f6-a632-21f66a4311f8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.053242] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e155778-3c23-43f6-a632-21f66a4311f8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.053478] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.053602] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.053671] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.053825] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.053913] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.054048] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e155778-3c23-43f6-a632-21f66a4311f8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.054204] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e155778-3c23-43f6-a632-21f66a4311f8 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.054252] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e155778-3c23-43f6-a632-21f66a4311f8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.054301] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e155778-3c23-43f6-a632-21f66a4311f8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.054452] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e155778-3c23-43f6-a632-21f66a4311f8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.054570] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.054659] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.055195] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.055195] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.055195] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.055195] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e155778-3c23-43f6-a632-21f66a4311f8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.055195] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5e155778-3c23-43f6-a632-21f66a4311f8',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.056056] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e155778-3c23-43f6-a632-21f66a4311f8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.056145] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e155778-3c23-43f6-a632-21f66a4311f8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.056301] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.056401] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.056469] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.056885] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.056885] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.056885] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5e155778-3c23-43f6-a632-21f66a4311f8',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.527260] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.527513] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.527513] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.527682] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.527771] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.527868] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e7bf0fa-24cf-40f7-ac38-1adabda5207c is going to be created. [ 741.561162] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5e155778-3c23-43f6-a632-21f66a4311f8',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.562915] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5e155778-3c23-43f6-a632-21f66a4311f8: rpc.has_security_group_logging(os_id): False [ 741.565316] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.565566] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.565566] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.565729] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.565894] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.594130] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e7bf0fa-24cf-40f7-ac38-1adabda5207c in Status: UNINITIALIZED for 2s [ 741.600867] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.601594] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.601594] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.601594] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.601762] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.601983] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.602233] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.602345] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.603250] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.603250] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.603250] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.603410] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.603611] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.604132] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.604229] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.604735] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.604966] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.605103] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.605493] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.605708] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.605882] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5e155778-3c23-43f6-a632-21f66a4311f8 is going to be created. [ 741.700122] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.700354] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.700432] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.700792] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.701164] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.715476] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5e155778-3c23-43f6-a632-21f66a4311f8 in Status: IN_PROGRESS for 2s [ 741.824151] env[69232]: INFO networking_nsxv3.common.synchronization [req-fa8f9e09-7503-4e92-9ded-f6f64c412b82 req-f9877e74-26d5-4d24-8cdf-21da2254d869 tempest-ImagesTestJSON-1245210724 tempest-ImagesTestJSON-1245210724-project-member] Enqueued Resource ID: fb3494b9-4ce5-4744-a378-ecbcd5c2bec9 with Priority: HIGHEST for action security_group_members [ 741.824151] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb3494b9-4ce5-4744-a378-ecbcd5c2bec9 with Priority: HIGHEST for action security_group_members [ 741.824151] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.824151] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.824151] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.824151] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.824151] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.824151] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.824151] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.824151] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.824151] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.824151] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fb3494b9-4ce5-4744-a378-ecbcd5c2bec9',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.065507] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5e155778-3c23-43f6-a632-21f66a4311f8',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.327343] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.333027] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.333027] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.333027] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.333027] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.333027] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.333027] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.333027] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.333027] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.333027] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.333027] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb3494b9-4ce5-4744-a378-ecbcd5c2bec9 is going to be updated. [ 742.365016] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.365016] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.365016] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.365016] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.365016] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.379781] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb3494b9-4ce5-4744-a378-ecbcd5c2bec9 in Status: IN_PROGRESS for 2s [ 742.570861] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.571302] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.571302] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.571302] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.571384] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.571545] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e155778-3c23-43f6-a632-21f66a4311f8 is going to be updated. [ 742.608899] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.609228] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.609314] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.609532] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.609678] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.620797] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e155778-3c23-43f6-a632-21f66a4311f8 in Status: IN_PROGRESS for 2s [ 743.605258] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e7bf0fa-24cf-40f7-ac38-1adabda5207c in Status: SUCCESS [ 743.606437] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e7bf0fa-24cf-40f7-ac38-1adabda5207c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.606437] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e7bf0fa-24cf-40f7-ac38-1adabda5207c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.606437] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e7bf0fa-24cf-40f7-ac38-1adabda5207c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.606437] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.606686] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.606686] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.606803] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.606803] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.607813] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e7bf0fa-24cf-40f7-ac38-1adabda5207c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.607813] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6e7bf0fa-24cf-40f7-ac38-1adabda5207c',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.731151] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5e155778-3c23-43f6-a632-21f66a4311f8 in Status: SUCCESS [ 743.731389] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5e155778-3c23-43f6-a632-21f66a4311f8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.731578] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5e155778-3c23-43f6-a632-21f66a4311f8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.731954] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5e155778-3c23-43f6-a632-21f66a4311f8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.731954] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5e155778-3c23-43f6-a632-21f66a4311f8',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.109249] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e7bf0fa-24cf-40f7-ac38-1adabda5207c taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.109411] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e7bf0fa-24cf-40f7-ac38-1adabda5207c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.109484] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e7bf0fa-24cf-40f7-ac38-1adabda5207c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.109707] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e7bf0fa-24cf-40f7-ac38-1adabda5207c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.109908] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.110021] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.110088] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.110465] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.110565] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.110656] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e7bf0fa-24cf-40f7-ac38-1adabda5207c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.110808] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e7bf0fa-24cf-40f7-ac38-1adabda5207c taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.110904] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e7bf0fa-24cf-40f7-ac38-1adabda5207c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.110963] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e7bf0fa-24cf-40f7-ac38-1adabda5207c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.112685] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e7bf0fa-24cf-40f7-ac38-1adabda5207c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.112685] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.112685] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.112685] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.112685] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.112685] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.112685] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e7bf0fa-24cf-40f7-ac38-1adabda5207c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.112685] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6e7bf0fa-24cf-40f7-ac38-1adabda5207c',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.234894] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e155778-3c23-43f6-a632-21f66a4311f8 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.234894] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e155778-3c23-43f6-a632-21f66a4311f8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.390812] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb3494b9-4ce5-4744-a378-ecbcd5c2bec9 in Status: SUCCESS [ 744.390812] env[69232]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb3494b9-4ce5-4744-a378-ecbcd5c2bec9 deletion is rescheduled due to dependency. [ 744.390812] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.615163] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6e7bf0fa-24cf-40f7-ac38-1adabda5207c: rpc.has_security_group_logging(os_id): False [ 744.634598] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e155778-3c23-43f6-a632-21f66a4311f8 in Status: SUCCESS [ 744.634890] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e155778-3c23-43f6-a632-21f66a4311f8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.635050] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e155778-3c23-43f6-a632-21f66a4311f8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.635298] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e155778-3c23-43f6-a632-21f66a4311f8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.635534] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.636075] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.636075] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.636075] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.636075] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.636075] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e155778-3c23-43f6-a632-21f66a4311f8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.636247] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5e155778-3c23-43f6-a632-21f66a4311f8',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.638045] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.638268] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.638268] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.638546] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.638546] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.638841] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.638841] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.639049] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.639049] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.639155] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.639343] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.639537] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.639537] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.639901] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.639901] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.639901] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.640241] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.640241] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.640241] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.640329] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.640329] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6e7bf0fa-24cf-40f7-ac38-1adabda5207c is going to be created. [ 744.719699] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.719699] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.719699] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.719699] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.719699] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.740966] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6e7bf0fa-24cf-40f7-ac38-1adabda5207c in Status: IN_PROGRESS for 2s [ 744.778263] env[69232]: INFO networking_nsxv3.common.synchronization [req-e3666659-37db-441b-9871-e78e95a7d101 req-5de32466-acb9-40e3-8355-810e663bb37a tempest-ServerAddressesNegativeTestJSON-1184128985 tempest-ServerAddressesNegativeTestJSON-1184128985-project-member] Enqueued Resource ID: 70f65c0d-8fd1-4807-94b2-0a9403b8c3d4 with Priority: HIGHEST for action security_group_members [ 744.778536] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70f65c0d-8fd1-4807-94b2-0a9403b8c3d4 with Priority: HIGHEST for action security_group_members [ 744.778888] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-70f65c0d-8fd1-4807-94b2-0a9403b8c3d4 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.779145] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-70f65c0d-8fd1-4807-94b2-0a9403b8c3d4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.779145] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-70f65c0d-8fd1-4807-94b2-0a9403b8c3d4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.779583] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-70f65c0d-8fd1-4807-94b2-0a9403b8c3d4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.779583] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.779948] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.779948] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.779948] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.780249] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.780249] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('70f65c0d-8fd1-4807-94b2-0a9403b8c3d4',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.102027] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock network-26 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.102027] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "network-26" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.102027] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "network-26" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.104093] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "network-26" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.104093] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.104093] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.104093] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.104093] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.104093] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.104093] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 745.104093] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] NeedRegenerationException {{(pid=69232) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 745.104093] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] no value, waiting for create lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 745.104093] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] value creation lock acquired {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 745.104669] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 745.104669] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Calling creation function for not-yet-present value {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 745.104939] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 745.137221] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 745.137404] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Cache value generated in 0.033 seconds for key(s): 'zone-id' {{(pid=69232) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 745.137548] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Released creation lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 745.137922] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "network-26" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.138064] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock port-985e42d2-3940-43ea-9a1e-89baad596e13 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.138243] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "port-985e42d2-3940-43ea-9a1e-89baad596e13" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.138362] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "port-985e42d2-3940-43ea-9a1e-89baad596e13" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.138724] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "port-985e42d2-3940-43ea-9a1e-89baad596e13" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.138862] env[69232]: DEBUG networking_nsxv3.api.rpc [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('985e42d2-3940-43ea-9a1e-89baad596e13',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.142877] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e155778-3c23-43f6-a632-21f66a4311f8 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.142877] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e155778-3c23-43f6-a632-21f66a4311f8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.142877] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e155778-3c23-43f6-a632-21f66a4311f8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.143037] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e155778-3c23-43f6-a632-21f66a4311f8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.143236] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.143339] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.143397] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.143552] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.143634] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.143720] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e155778-3c23-43f6-a632-21f66a4311f8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.143867] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e155778-3c23-43f6-a632-21f66a4311f8 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.144817] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e155778-3c23-43f6-a632-21f66a4311f8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.144817] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e155778-3c23-43f6-a632-21f66a4311f8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.144817] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e155778-3c23-43f6-a632-21f66a4311f8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.144817] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.144817] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.144817] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.144817] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.144817] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.144817] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e155778-3c23-43f6-a632-21f66a4311f8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.144817] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5e155778-3c23-43f6-a632-21f66a4311f8',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.285215] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.285422] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.285600] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.285899] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.286538] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.286850] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.287053] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.287330] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.287605] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.287728] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.287877] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 70f65c0d-8fd1-4807-94b2-0a9403b8c3d4 already deleted. [ 745.288022] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-70f65c0d-8fd1-4807-94b2-0a9403b8c3d4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.642053] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.642407] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.642498] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.642754] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.642899] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.643074] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Segment Port 985e42d2-3940-43ea-9a1e-89baad596e13 not found, creating... [ 745.643345] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.643603] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.643603] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.643826] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.643965] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.644267] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.644422] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.644684] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.644978] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.649182] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.649521] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Resource: SegmentPort with ID: 985e42d2-3940-43ea-9a1e-89baad596e13 is going to be created. [ 745.651203] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5e155778-3c23-43f6-a632-21f66a4311f8: rpc.has_security_group_logging(os_id): False [ 745.681024] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.681206] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.681330] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.681632] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.681795] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.682120] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.682282] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.682397] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.682670] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.682817] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.683169] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.683325] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.683427] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.683665] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.683791] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.684108] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.684274] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.684400] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.684645] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.684728] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.684860] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5e155778-3c23-43f6-a632-21f66a4311f8 is going to be updated. [ 745.688415] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.688733] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.688938] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.690041] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.690041] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.690041] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "port-985e42d2-3940-43ea-9a1e-89baad596e13" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.762487] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.762655] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.762767] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.762993] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.763158] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.805814] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5e155778-3c23-43f6-a632-21f66a4311f8 in Status: IN_PROGRESS for 2s [ 746.403165] env[69232]: INFO networking_nsxv3.common.synchronization [req-e3666659-37db-441b-9871-e78e95a7d101 req-c83df0c5-2012-42aa-ad7e-7e8b0288ac7c service nova] Enqueued Resource ID: 70f65c0d-8fd1-4807-94b2-0a9403b8c3d4 with Priority: HIGHEST for action security_group_rules [ 746.403378] env[69232]: INFO networking_nsxv3.common.synchronization [req-e3666659-37db-441b-9871-e78e95a7d101 req-c83df0c5-2012-42aa-ad7e-7e8b0288ac7c service nova] Enqueued Resource ID: 70f65c0d-8fd1-4807-94b2-0a9403b8c3d4 with Priority: HIGHEST for action security_group_members [ 746.403517] env[69232]: INFO networking_nsxv3.common.synchronization [req-e3666659-37db-441b-9871-e78e95a7d101 req-c83df0c5-2012-42aa-ad7e-7e8b0288ac7c service nova] Enqueued Resource ID: 985e42d2-3940-43ea-9a1e-89baad596e13 with Priority: HIGHEST for action port [ 746.403749] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70f65c0d-8fd1-4807-94b2-0a9403b8c3d4 with Priority: HIGHEST for action security_group_rules [ 746.403900] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70f65c0d-8fd1-4807-94b2-0a9403b8c3d4 with Priority: HIGHEST for action security_group_members [ 746.404026] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 985e42d2-3940-43ea-9a1e-89baad596e13 with Priority: HIGHEST for action port [ 746.404570] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-70f65c0d-8fd1-4807-94b2-0a9403b8c3d4 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.404727] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-70f65c0d-8fd1-4807-94b2-0a9403b8c3d4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.404761] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-70f65c0d-8fd1-4807-94b2-0a9403b8c3d4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.405016] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-70f65c0d-8fd1-4807-94b2-0a9403b8c3d4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.406384] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('70f65c0d-8fd1-4807-94b2-0a9403b8c3d4',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.407257] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-70f65c0d-8fd1-4807-94b2-0a9403b8c3d4 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.407388] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-70f65c0d-8fd1-4807-94b2-0a9403b8c3d4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.407457] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-70f65c0d-8fd1-4807-94b2-0a9403b8c3d4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.407639] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-70f65c0d-8fd1-4807-94b2-0a9403b8c3d4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.407869] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.407975] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.408051] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.408210] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.408295] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.408389] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('70f65c0d-8fd1-4807-94b2-0a9403b8c3d4',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.409564] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-985e42d2-3940-43ea-9a1e-89baad596e13 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.409801] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-985e42d2-3940-43ea-9a1e-89baad596e13" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.409904] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-985e42d2-3940-43ea-9a1e-89baad596e13" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.410075] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-985e42d2-3940-43ea-9a1e-89baad596e13" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.410153] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('985e42d2-3940-43ea-9a1e-89baad596e13',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.752975] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6e7bf0fa-24cf-40f7-ac38-1adabda5207c in Status: SUCCESS [ 746.753341] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6e7bf0fa-24cf-40f7-ac38-1adabda5207c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.912397] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-70f65c0d-8fd1-4807-94b2-0a9403b8c3d4 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.912397] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-70f65c0d-8fd1-4807-94b2-0a9403b8c3d4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.912610] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('70f65c0d-8fd1-4807-94b2-0a9403b8c3d4',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.913499] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 985e42d2-3940-43ea-9a1e-89baad596e13 with status ACTIVE [ 746.915173] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.915173] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.915173] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.915173] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.915173] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.915173] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.915173] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.915173] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.915173] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.915173] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.915173] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.915173] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.915173] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.915557] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.915557] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.915557] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 985e42d2-3940-43ea-9a1e-89baad596e13 is going to be updated. [ 746.939663] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.939880] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.939982] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.940316] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.940494] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.940689] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-985e42d2-3940-43ea-9a1e-89baad596e13" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.417063] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('70f65c0d-8fd1-4807-94b2-0a9403b8c3d4',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.541133] env[69232]: INFO networking_nsxv3.common.synchronization [req-4f4f2005-6750-460c-9be4-ae1e375bdcff req-cf64b31a-a0c9-40ab-90f8-74d1d65c6c30 tempest-ServersTestManualDisk-382677829 tempest-ServersTestManualDisk-382677829-project-member] Enqueued Resource ID: 24c49db3-d2db-437b-976f-e83851ddd42c with Priority: HIGHEST for action security_group_members [ 747.541133] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24c49db3-d2db-437b-976f-e83851ddd42c with Priority: HIGHEST for action security_group_members [ 747.542041] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-24c49db3-d2db-437b-976f-e83851ddd42c taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.542358] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-24c49db3-d2db-437b-976f-e83851ddd42c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.542613] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-24c49db3-d2db-437b-976f-e83851ddd42c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.543919] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-24c49db3-d2db-437b-976f-e83851ddd42c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.544176] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.544271] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.547426] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.547426] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.547426] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.547426] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('24c49db3-d2db-437b-976f-e83851ddd42c',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.827026] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5e155778-3c23-43f6-a632-21f66a4311f8 in Status: SUCCESS [ 747.827344] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5e155778-3c23-43f6-a632-21f66a4311f8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.827878] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5e155778-3c23-43f6-a632-21f66a4311f8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.828880] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5e155778-3c23-43f6-a632-21f66a4311f8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.828880] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5e155778-3c23-43f6-a632-21f66a4311f8',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.884093] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock network-191 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.885098] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "network-191" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.885098] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "network-191" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.885098] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "network-191" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.885098] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.885373] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.885458] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.885705] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.885879] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.886135] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 747.886275] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] NeedRegenerationException {{(pid=69232) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 747.886419] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] no value, waiting for create lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 747.886555] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] value creation lock acquired {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 747.886668] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 747.886822] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Calling creation function for not-yet-present value {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 747.886902] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 747.908297] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 747.908493] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69232) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 747.908653] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Released creation lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 747.908946] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "network-191" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.909299] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock port-9a39d05a-4d4e-4c5b-9b9e-d09fa733962a taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.909562] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "port-9a39d05a-4d4e-4c5b-9b9e-d09fa733962a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.909623] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "port-9a39d05a-4d4e-4c5b-9b9e-d09fa733962a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.909964] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "port-9a39d05a-4d4e-4c5b-9b9e-d09fa733962a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.910124] env[69232]: DEBUG networking_nsxv3.api.rpc [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9a39d05a-4d4e-4c5b-9b9e-d09fa733962a',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.919774] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.919962] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.920052] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.920273] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.920368] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.920470] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 70f65c0d-8fd1-4807-94b2-0a9403b8c3d4 is going to be created. [ 747.950970] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.950970] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.950970] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.950970] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.950970] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.961392] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 70f65c0d-8fd1-4807-94b2-0a9403b8c3d4 in Status: UNINITIALIZED for 2s [ 748.049989] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.050107] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.050107] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.050312] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.050403] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.050599] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.051185] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.051185] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.051185] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.051185] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.051185] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 24c49db3-d2db-437b-976f-e83851ddd42c already deleted. [ 748.051185] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-24c49db3-d2db-437b-976f-e83851ddd42c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.331064] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e155778-3c23-43f6-a632-21f66a4311f8 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.331282] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e155778-3c23-43f6-a632-21f66a4311f8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.331381] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e155778-3c23-43f6-a632-21f66a4311f8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.331577] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e155778-3c23-43f6-a632-21f66a4311f8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.331745] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.331843] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.331908] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.332070] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.332160] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.332247] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e155778-3c23-43f6-a632-21f66a4311f8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.332338] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5e155778-3c23-43f6-a632-21f66a4311f8',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.414095] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.414532] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.414771] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.415302] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.416825] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.416825] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Segment Port 9a39d05a-4d4e-4c5b-9b9e-d09fa733962a not found, creating... [ 748.416825] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.416825] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.416825] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.416825] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.416825] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.417606] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.417904] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.418174] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.418489] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.418741] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.419105] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Resource: SegmentPort with ID: 9a39d05a-4d4e-4c5b-9b9e-d09fa733962a is going to be created. [ 748.446908] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.446908] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.446908] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.446908] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.446908] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.446908] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "port-9a39d05a-4d4e-4c5b-9b9e-d09fa733962a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.835350] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e155778-3c23-43f6-a632-21f66a4311f8 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.835662] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e155778-3c23-43f6-a632-21f66a4311f8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.835662] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e155778-3c23-43f6-a632-21f66a4311f8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.835795] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e155778-3c23-43f6-a632-21f66a4311f8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.835962] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.837109] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.837109] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.837109] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.837109] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.837109] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e155778-3c23-43f6-a632-21f66a4311f8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.837109] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e155778-3c23-43f6-a632-21f66a4311f8 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.837109] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e155778-3c23-43f6-a632-21f66a4311f8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.837109] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e155778-3c23-43f6-a632-21f66a4311f8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.837109] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e155778-3c23-43f6-a632-21f66a4311f8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.837480] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.837480] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.837480] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.837585] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.837673] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.837761] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e155778-3c23-43f6-a632-21f66a4311f8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.837888] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5e155778-3c23-43f6-a632-21f66a4311f8',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.156433] env[69232]: INFO networking_nsxv3.common.synchronization [req-4f4f2005-6750-460c-9be4-ae1e375bdcff req-b14b0034-5e60-4cb1-a19c-b1e8b27b3fb0 service nova] Enqueued Resource ID: 24c49db3-d2db-437b-976f-e83851ddd42c with Priority: HIGHEST for action security_group_rules [ 749.156730] env[69232]: INFO networking_nsxv3.common.synchronization [req-4f4f2005-6750-460c-9be4-ae1e375bdcff req-b14b0034-5e60-4cb1-a19c-b1e8b27b3fb0 service nova] Enqueued Resource ID: 24c49db3-d2db-437b-976f-e83851ddd42c with Priority: HIGHEST for action security_group_members [ 749.156851] env[69232]: INFO networking_nsxv3.common.synchronization [req-4f4f2005-6750-460c-9be4-ae1e375bdcff req-b14b0034-5e60-4cb1-a19c-b1e8b27b3fb0 service nova] Enqueued Resource ID: 9a39d05a-4d4e-4c5b-9b9e-d09fa733962a with Priority: HIGHEST for action port [ 749.157481] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24c49db3-d2db-437b-976f-e83851ddd42c with Priority: HIGHEST for action security_group_rules [ 749.157622] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24c49db3-d2db-437b-976f-e83851ddd42c with Priority: HIGHEST for action security_group_members [ 749.157757] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a39d05a-4d4e-4c5b-9b9e-d09fa733962a with Priority: HIGHEST for action port [ 749.158089] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-24c49db3-d2db-437b-976f-e83851ddd42c taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.158241] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-24c49db3-d2db-437b-976f-e83851ddd42c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.158326] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-24c49db3-d2db-437b-976f-e83851ddd42c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.158550] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-24c49db3-d2db-437b-976f-e83851ddd42c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.158674] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('24c49db3-d2db-437b-976f-e83851ddd42c',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.159939] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-24c49db3-d2db-437b-976f-e83851ddd42c taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.161655] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-24c49db3-d2db-437b-976f-e83851ddd42c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.161655] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-24c49db3-d2db-437b-976f-e83851ddd42c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.161655] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-24c49db3-d2db-437b-976f-e83851ddd42c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.161655] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.161655] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.161655] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.161655] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.161655] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.161655] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('24c49db3-d2db-437b-976f-e83851ddd42c',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.162126] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-9a39d05a-4d4e-4c5b-9b9e-d09fa733962a taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.162126] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9a39d05a-4d4e-4c5b-9b9e-d09fa733962a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.162126] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9a39d05a-4d4e-4c5b-9b9e-d09fa733962a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.162531] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9a39d05a-4d4e-4c5b-9b9e-d09fa733962a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.162531] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9a39d05a-4d4e-4c5b-9b9e-d09fa733962a',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.348767] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5e155778-3c23-43f6-a632-21f66a4311f8: rpc.has_security_group_logging(os_id): False [ 749.371942] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.372132] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.372171] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.372391] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.372482] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.373355] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.373355] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.373355] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.373355] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.373355] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.373355] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.373645] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.373645] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.373645] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.373737] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.373881] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.373970] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.374388] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.374598] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.374734] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.374862] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5e155778-3c23-43f6-a632-21f66a4311f8 is going to be updated. [ 749.423629] env[69232]: INFO networking_nsxv3.common.synchronization [req-41022b6f-0c6c-478a-abf0-6669884fc622 req-9f286f47-76ad-4fce-83f3-e3131d861a28 tempest-AttachInterfacesUnderV243Test-115986106 tempest-AttachInterfacesUnderV243Test-115986106-project-member] Enqueued Resource ID: 393d1484-2236-4219-a1eb-b4013eec039a with Priority: HIGHEST for action security_group_members [ 749.423629] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 393d1484-2236-4219-a1eb-b4013eec039a with Priority: HIGHEST for action security_group_members [ 749.423629] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-393d1484-2236-4219-a1eb-b4013eec039a taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.423629] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-393d1484-2236-4219-a1eb-b4013eec039a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.423629] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-393d1484-2236-4219-a1eb-b4013eec039a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.423629] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-393d1484-2236-4219-a1eb-b4013eec039a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.423629] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.423629] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.423911] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.423911] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.423911] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.424058] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('393d1484-2236-4219-a1eb-b4013eec039a',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.438788] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.438872] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.438967] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.439217] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.439362] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.452640] env[69232]: INFO networking_nsxv3.common.synchronization [req-41022b6f-0c6c-478a-abf0-6669884fc622 req-9f286f47-76ad-4fce-83f3-e3131d861a28 tempest-AttachInterfacesUnderV243Test-115986106 tempest-AttachInterfacesUnderV243Test-115986106-project-member] Enqueued Resource ID: 393d1484-2236-4219-a1eb-b4013eec039a with Priority: HIGHEST for action security_group_rules [ 749.452829] env[69232]: INFO networking_nsxv3.common.synchronization [req-41022b6f-0c6c-478a-abf0-6669884fc622 req-9f286f47-76ad-4fce-83f3-e3131d861a28 tempest-AttachInterfacesUnderV243Test-115986106 tempest-AttachInterfacesUnderV243Test-115986106-project-member] Enqueued Resource ID: 393d1484-2236-4219-a1eb-b4013eec039a with Priority: HIGHEST for action security_group_members [ 749.452956] env[69232]: INFO networking_nsxv3.common.synchronization [req-41022b6f-0c6c-478a-abf0-6669884fc622 req-9f286f47-76ad-4fce-83f3-e3131d861a28 tempest-AttachInterfacesUnderV243Test-115986106 tempest-AttachInterfacesUnderV243Test-115986106-project-member] Enqueued Resource ID: 7706e09f-3fd5-433f-8122-b1b583c71be8 with Priority: HIGHEST for action port [ 749.453515] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 393d1484-2236-4219-a1eb-b4013eec039a with Priority: HIGHEST for action security_group_rules [ 749.453653] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 393d1484-2236-4219-a1eb-b4013eec039a with Priority: HIGHEST for action security_group_members [ 749.453751] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7706e09f-3fd5-433f-8122-b1b583c71be8 with Priority: HIGHEST for action port [ 749.454595] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5e155778-3c23-43f6-a632-21f66a4311f8 in Status: IN_PROGRESS for 2s [ 749.454846] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-393d1484-2236-4219-a1eb-b4013eec039a taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.454967] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-393d1484-2236-4219-a1eb-b4013eec039a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.455044] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-393d1484-2236-4219-a1eb-b4013eec039a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.455243] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-393d1484-2236-4219-a1eb-b4013eec039a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.455326] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('393d1484-2236-4219-a1eb-b4013eec039a',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.456168] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-393d1484-2236-4219-a1eb-b4013eec039a taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.456310] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-393d1484-2236-4219-a1eb-b4013eec039a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.456601] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-7706e09f-3fd5-433f-8122-b1b583c71be8 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.456716] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7706e09f-3fd5-433f-8122-b1b583c71be8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.456798] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7706e09f-3fd5-433f-8122-b1b583c71be8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.457161] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7706e09f-3fd5-433f-8122-b1b583c71be8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.457249] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7706e09f-3fd5-433f-8122-b1b583c71be8',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.664450] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('24c49db3-d2db-437b-976f-e83851ddd42c',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.665704] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-24c49db3-d2db-437b-976f-e83851ddd42c taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.665816] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-24c49db3-d2db-437b-976f-e83851ddd42c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.665985] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9a39d05a-4d4e-4c5b-9b9e-d09fa733962a with status ACTIVE [ 749.666251] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.666309] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.666366] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.666557] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.666674] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.666813] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.666913] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.666972] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.667330] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.667407] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.667593] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.667683] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.667751] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.667891] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.667959] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.668062] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9a39d05a-4d4e-4c5b-9b9e-d09fa733962a is going to be updated. [ 749.696885] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.697133] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.697133] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.697372] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.697517] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.697682] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9a39d05a-4d4e-4c5b-9b9e-d09fa733962a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.927936] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('393d1484-2236-4219-a1eb-b4013eec039a',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.959641] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-393d1484-2236-4219-a1eb-b4013eec039a taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.959641] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-393d1484-2236-4219-a1eb-b4013eec039a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.965341] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7706e09f-3fd5-433f-8122-b1b583c71be8 with status ACTIVE [ 749.965341] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.965341] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.965341] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.965341] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.965341] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.965341] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.965341] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.965341] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.965341] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.965341] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.965341] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.965341] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.965341] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.965341] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.965341] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.965341] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7706e09f-3fd5-433f-8122-b1b583c71be8 is going to be updated. [ 749.982395] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 70f65c0d-8fd1-4807-94b2-0a9403b8c3d4 in Status: SUCCESS [ 749.982395] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-70f65c0d-8fd1-4807-94b2-0a9403b8c3d4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.982395] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-70f65c0d-8fd1-4807-94b2-0a9403b8c3d4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.982395] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-70f65c0d-8fd1-4807-94b2-0a9403b8c3d4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.982395] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.982395] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.982395] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.982395] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.982395] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.982395] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-70f65c0d-8fd1-4807-94b2-0a9403b8c3d4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.982395] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('70f65c0d-8fd1-4807-94b2-0a9403b8c3d4',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.988873] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.989263] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.989458] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.989758] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.990081] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.990358] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7706e09f-3fd5-433f-8122-b1b583c71be8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.172036] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('24c49db3-d2db-437b-976f-e83851ddd42c',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.430135] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('393d1484-2236-4219-a1eb-b4013eec039a',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.488740] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-70f65c0d-8fd1-4807-94b2-0a9403b8c3d4 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.488892] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-70f65c0d-8fd1-4807-94b2-0a9403b8c3d4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.488959] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-70f65c0d-8fd1-4807-94b2-0a9403b8c3d4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.489191] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-70f65c0d-8fd1-4807-94b2-0a9403b8c3d4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.489428] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.489525] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.489525] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.489696] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.489829] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.489970] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-70f65c0d-8fd1-4807-94b2-0a9403b8c3d4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.490205] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-70f65c0d-8fd1-4807-94b2-0a9403b8c3d4 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.490346] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-70f65c0d-8fd1-4807-94b2-0a9403b8c3d4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.490594] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-70f65c0d-8fd1-4807-94b2-0a9403b8c3d4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.490658] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-70f65c0d-8fd1-4807-94b2-0a9403b8c3d4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.490859] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.491028] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.493374] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.493374] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.493374] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.493374] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-70f65c0d-8fd1-4807-94b2-0a9403b8c3d4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.493374] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('70f65c0d-8fd1-4807-94b2-0a9403b8c3d4',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.673605] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.673744] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.673786] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.674817] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.674817] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.674817] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 24c49db3-d2db-437b-976f-e83851ddd42c is going to be created. [ 750.699430] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.699617] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.699660] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.699962] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.700181] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.713012] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 24c49db3-d2db-437b-976f-e83851ddd42c in Status: UNINITIALIZED for 2s [ 750.933047] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.933387] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.933387] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.933674] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.933825] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.933998] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 393d1484-2236-4219-a1eb-b4013eec039a is going to be updated. [ 750.968225] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.968376] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.968448] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.968695] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.968874] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.981144] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 393d1484-2236-4219-a1eb-b4013eec039a in Status: IN_PROGRESS for 2s [ 750.994924] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 70f65c0d-8fd1-4807-94b2-0a9403b8c3d4: rpc.has_security_group_logging(os_id): False [ 751.018741] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.018741] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.018954] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.019043] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.019123] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.019329] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.019904] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.019904] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.019904] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.019904] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.021018] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.021018] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.021018] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.021018] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.021018] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.021018] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.021018] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.021018] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.021018] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.021018] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.021018] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 70f65c0d-8fd1-4807-94b2-0a9403b8c3d4 is going to be created. [ 751.098690] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.098832] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.098907] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.099152] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.099375] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.114033] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 70f65c0d-8fd1-4807-94b2-0a9403b8c3d4 in Status: IN_PROGRESS for 2s [ 751.473666] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5e155778-3c23-43f6-a632-21f66a4311f8 in Status: SUCCESS [ 751.473666] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5e155778-3c23-43f6-a632-21f66a4311f8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.697052] env[69232]: INFO networking_nsxv3.common.synchronization [req-7834c1b5-ba92-46b7-93b5-bfacf8696d11 req-8f8ea738-792c-4d02-8716-47f4f21ceca3 tempest-MigrationsAdminTest-606964981 tempest-MigrationsAdminTest-606964981-project-member] Enqueued Resource ID: 531d0f92-2e98-47df-b32d-d49e1d2f34c1 with Priority: HIGHEST for action security_group_members [ 752.697586] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 531d0f92-2e98-47df-b32d-d49e1d2f34c1 with Priority: HIGHEST for action security_group_members [ 752.698516] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-531d0f92-2e98-47df-b32d-d49e1d2f34c1 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.698638] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-531d0f92-2e98-47df-b32d-d49e1d2f34c1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.698789] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-531d0f92-2e98-47df-b32d-d49e1d2f34c1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.698933] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-531d0f92-2e98-47df-b32d-d49e1d2f34c1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.699113] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.699870] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.699952] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.700500] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.700771] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.700771] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('531d0f92-2e98-47df-b32d-d49e1d2f34c1',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.724613] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 24c49db3-d2db-437b-976f-e83851ddd42c in Status: SUCCESS [ 752.724920] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-24c49db3-d2db-437b-976f-e83851ddd42c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.725130] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-24c49db3-d2db-437b-976f-e83851ddd42c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.725355] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-24c49db3-d2db-437b-976f-e83851ddd42c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.725550] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.725662] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.725724] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.725907] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.725974] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.726082] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-24c49db3-d2db-437b-976f-e83851ddd42c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.726206] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('24c49db3-d2db-437b-976f-e83851ddd42c',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.812071] env[69232]: INFO networking_nsxv3.common.synchronization [req-2a5f758e-d879-40e3-b55e-1e3b58c8010c req-2778a98d-6c21-404c-801c-25e16cacec99 tempest-ServerDiskConfigTestJSON-1562148127 tempest-ServerDiskConfigTestJSON-1562148127-project-member] Enqueued Resource ID: 5a45a455-673b-417d-b2f6-be9352c2077e with Priority: HIGHEST for action security_group_members [ 752.812582] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a45a455-673b-417d-b2f6-be9352c2077e with Priority: HIGHEST for action security_group_members [ 752.813164] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a45a455-673b-417d-b2f6-be9352c2077e taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.813302] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a45a455-673b-417d-b2f6-be9352c2077e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.813389] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a45a455-673b-417d-b2f6-be9352c2077e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.813568] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a45a455-673b-417d-b2f6-be9352c2077e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.813882] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.813882] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.813882] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.814928] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.814928] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.814928] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5a45a455-673b-417d-b2f6-be9352c2077e',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.992602] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 393d1484-2236-4219-a1eb-b4013eec039a in Status: SUCCESS [ 752.992808] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-393d1484-2236-4219-a1eb-b4013eec039a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.993782] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-393d1484-2236-4219-a1eb-b4013eec039a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.993782] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-393d1484-2236-4219-a1eb-b4013eec039a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.993782] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.993959] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.993959] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.994043] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.994111] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.994205] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('393d1484-2236-4219-a1eb-b4013eec039a',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.124898] env[69232]: INFO networking_nsxv3.common.synchronization [req-67d035be-0b3b-463b-a222-5a80b6b0e6f0 req-f69fbb9e-4067-493e-aeeb-f0fdd7aeab79 tempest-ServersTestMultiNic-1112914223 tempest-ServersTestMultiNic-1112914223-project-member] Enqueued Resource ID: 5e155778-3c23-43f6-a632-21f66a4311f8 with Priority: HIGHEST for action security_group_members [ 753.125426] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e155778-3c23-43f6-a632-21f66a4311f8 with Priority: HIGHEST for action security_group_members [ 753.125721] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e155778-3c23-43f6-a632-21f66a4311f8 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.125843] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e155778-3c23-43f6-a632-21f66a4311f8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.125911] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e155778-3c23-43f6-a632-21f66a4311f8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.126372] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e155778-3c23-43f6-a632-21f66a4311f8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.126372] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.126372] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.126602] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.126602] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.126693] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.126784] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5e155778-3c23-43f6-a632-21f66a4311f8',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.131615] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 70f65c0d-8fd1-4807-94b2-0a9403b8c3d4 in Status: SUCCESS [ 753.131615] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-70f65c0d-8fd1-4807-94b2-0a9403b8c3d4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.173724] env[69232]: INFO networking_nsxv3.common.synchronization [req-3c4826e9-4667-491a-b89e-8e7b476731d5 req-cb9167bb-e7ac-459d-bfb4-f380995b0a6a tempest-AttachInterfacesUnderV243Test-115986106 tempest-AttachInterfacesUnderV243Test-115986106-project-member] Enqueued Resource ID: 393d1484-2236-4219-a1eb-b4013eec039a with Priority: HIGHEST for action security_group_members [ 753.175917] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 393d1484-2236-4219-a1eb-b4013eec039a with Priority: HIGHEST for action security_group_members [ 753.175917] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-393d1484-2236-4219-a1eb-b4013eec039a taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.175917] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-393d1484-2236-4219-a1eb-b4013eec039a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.204067] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('531d0f92-2e98-47df-b32d-d49e1d2f34c1',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.223557] env[69232]: INFO networking_nsxv3.common.synchronization [req-3c4826e9-4667-491a-b89e-8e7b476731d5 req-cb9167bb-e7ac-459d-bfb4-f380995b0a6a tempest-AttachInterfacesUnderV243Test-115986106 tempest-AttachInterfacesUnderV243Test-115986106-project-member] Enqueued Resource ID: 393d1484-2236-4219-a1eb-b4013eec039a with Priority: HIGHEST for action security_group_rules [ 753.223557] env[69232]: INFO networking_nsxv3.common.synchronization [req-3c4826e9-4667-491a-b89e-8e7b476731d5 req-cb9167bb-e7ac-459d-bfb4-f380995b0a6a tempest-AttachInterfacesUnderV243Test-115986106 tempest-AttachInterfacesUnderV243Test-115986106-project-member] Enqueued Resource ID: 393d1484-2236-4219-a1eb-b4013eec039a with Priority: HIGHEST for action security_group_members [ 753.223557] env[69232]: INFO networking_nsxv3.common.synchronization [req-3c4826e9-4667-491a-b89e-8e7b476731d5 req-cb9167bb-e7ac-459d-bfb4-f380995b0a6a tempest-AttachInterfacesUnderV243Test-115986106 tempest-AttachInterfacesUnderV243Test-115986106-project-member] Enqueued Resource ID: 7706e09f-3fd5-433f-8122-b1b583c71be8 with Priority: HIGHEST for action port [ 753.223945] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 393d1484-2236-4219-a1eb-b4013eec039a with Priority: HIGHEST for action security_group_rules [ 753.224282] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 393d1484-2236-4219-a1eb-b4013eec039a with Priority: HIGHEST for action security_group_members [ 753.224565] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7706e09f-3fd5-433f-8122-b1b583c71be8 with Priority: HIGHEST for action port [ 753.225288] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-393d1484-2236-4219-a1eb-b4013eec039a taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.225580] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-393d1484-2236-4219-a1eb-b4013eec039a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.226114] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-393d1484-2236-4219-a1eb-b4013eec039a taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.226447] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-393d1484-2236-4219-a1eb-b4013eec039a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.226840] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-7706e09f-3fd5-433f-8122-b1b583c71be8 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.227783] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7706e09f-3fd5-433f-8122-b1b583c71be8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.228026] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7706e09f-3fd5-433f-8122-b1b583c71be8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.228387] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7706e09f-3fd5-433f-8122-b1b583c71be8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.229984] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7706e09f-3fd5-433f-8122-b1b583c71be8',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.230740] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('24c49db3-d2db-437b-976f-e83851ddd42c',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.316704] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.316885] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.316968] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.317227] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.317312] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.317517] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.317612] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.317675] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.318038] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.318126] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.318223] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5a45a455-673b-417d-b2f6-be9352c2077e is going to be updated. [ 753.353176] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.353311] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.353726] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.353958] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.354114] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.365587] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a45a455-673b-417d-b2f6-be9352c2077e in Status: IN_PROGRESS for 2s [ 753.390407] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock network-225 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.390608] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "network-225" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.390727] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "network-225" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.391016] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "network-225" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.391281] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.391440] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.391554] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.391777] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.391923] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.392383] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 753.392504] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] NeedRegenerationException {{(pid=69232) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 753.392624] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] no value, waiting for create lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 753.392729] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] value creation lock acquired {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 753.392848] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 753.392957] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Calling creation function for not-yet-present value {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 753.393102] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 753.416257] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 753.416452] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69232) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 753.416555] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Released creation lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 753.416730] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "network-225" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.417091] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock port-ce97a929-4294-4145-a93f-b32689dbbaec taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.417616] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "port-ce97a929-4294-4145-a93f-b32689dbbaec" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.417616] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "port-ce97a929-4294-4145-a93f-b32689dbbaec" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.417822] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "port-ce97a929-4294-4145-a93f-b32689dbbaec" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.417964] env[69232]: DEBUG networking_nsxv3.api.rpc [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ce97a929-4294-4145-a93f-b32689dbbaec',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.446917] env[69232]: INFO networking_nsxv3.common.synchronization [req-67d035be-0b3b-463b-a222-5a80b6b0e6f0 req-13b5481e-3897-4899-b0ed-c1dd36cba7d7 tempest-ServersTestMultiNic-1112914223 tempest-ServersTestMultiNic-1112914223-project-member] Enqueued Resource ID: 5e155778-3c23-43f6-a632-21f66a4311f8 with Priority: HIGHEST for action security_group_members [ 753.447596] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e155778-3c23-43f6-a632-21f66a4311f8 with Priority: HIGHEST for action security_group_members [ 753.448819] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e155778-3c23-43f6-a632-21f66a4311f8 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.448819] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e155778-3c23-43f6-a632-21f66a4311f8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.495851] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('393d1484-2236-4219-a1eb-b4013eec039a',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.633344] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5e155778-3c23-43f6-a632-21f66a4311f8',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.654013] env[69232]: INFO networking_nsxv3.common.synchronization [req-67d035be-0b3b-463b-a222-5a80b6b0e6f0 req-399c8888-38e0-40f3-939d-df9ac0f7d6d5 tempest-ServersTestMultiNic-1112914223 tempest-ServersTestMultiNic-1112914223-project-member] Enqueued Resource ID: 5e155778-3c23-43f6-a632-21f66a4311f8 with Priority: HIGHEST for action security_group_members [ 753.655335] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e155778-3c23-43f6-a632-21f66a4311f8 with Priority: HIGHEST for action security_group_members [ 753.656189] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e155778-3c23-43f6-a632-21f66a4311f8 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.656468] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e155778-3c23-43f6-a632-21f66a4311f8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.706598] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('531d0f92-2e98-47df-b32d-d49e1d2f34c1',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.733208] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7706e09f-3fd5-433f-8122-b1b583c71be8 with status ACTIVE [ 753.733467] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.733610] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.733740] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.734081] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.735473] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.735473] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.735473] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.735473] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.735473] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.735473] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.735473] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.735473] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.735473] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.735473] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.735473] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.735999] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7706e09f-3fd5-433f-8122-b1b583c71be8 is going to be updated. [ 753.737640] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 24c49db3-d2db-437b-976f-e83851ddd42c: rpc.has_security_group_logging(os_id): False [ 753.762249] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.762468] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.762553] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.762847] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.762974] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.763293] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.763422] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.763493] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.763709] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.763751] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.763841] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 24c49db3-d2db-437b-976f-e83851ddd42c is going to be created. [ 753.767622] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.768151] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.768151] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.768323] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.768388] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.768593] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7706e09f-3fd5-433f-8122-b1b583c71be8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.855488] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.855768] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.855768] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.855943] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.856188] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.873913] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 24c49db3-d2db-437b-976f-e83851ddd42c in Status: IN_PROGRESS for 2s [ 753.921543] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.921836] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.921992] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.922344] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.922517] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.922722] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Segment Port ce97a929-4294-4145-a93f-b32689dbbaec not found, creating... [ 753.923151] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.923378] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.923544] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.923819] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.923979] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.926506] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.926692] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.926805] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.927073] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.927957] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.927957] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Resource: SegmentPort with ID: ce97a929-4294-4145-a93f-b32689dbbaec is going to be created. [ 753.952381] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.953573] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.953573] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.953573] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.953573] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.953573] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "port-ce97a929-4294-4145-a93f-b32689dbbaec" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.997921] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('393d1484-2236-4219-a1eb-b4013eec039a',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.135548] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5e155778-3c23-43f6-a632-21f66a4311f8',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.210021] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.210021] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.210021] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.210021] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.210021] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.210021] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 531d0f92-2e98-47df-b32d-d49e1d2f34c1 is going to be updated. [ 754.243449] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.243691] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.243691] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.243893] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.244015] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.253419] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 531d0f92-2e98-47df-b32d-d49e1d2f34c1 in Status: IN_PROGRESS for 2s [ 754.500858] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.501053] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.501469] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.501469] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.501469] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.501638] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 393d1484-2236-4219-a1eb-b4013eec039a is going to be updated. [ 754.542839] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.542839] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.542839] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.542839] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.542839] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.561999] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 393d1484-2236-4219-a1eb-b4013eec039a in Status: IN_PROGRESS for 2s [ 754.642505] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.642793] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.642912] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.643191] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.643309] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.643602] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e155778-3c23-43f6-a632-21f66a4311f8 is going to be updated. [ 754.684102] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.684253] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.684489] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.684564] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.684665] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.693098] env[69232]: INFO networking_nsxv3.common.synchronization [req-7834c1b5-ba92-46b7-93b5-bfacf8696d11 req-3375dec3-e95b-4414-88c3-dbf43939567f service nova] Enqueued Resource ID: 531d0f92-2e98-47df-b32d-d49e1d2f34c1 with Priority: HIGHEST for action security_group_rules [ 754.693266] env[69232]: INFO networking_nsxv3.common.synchronization [req-7834c1b5-ba92-46b7-93b5-bfacf8696d11 req-3375dec3-e95b-4414-88c3-dbf43939567f service nova] Enqueued Resource ID: 531d0f92-2e98-47df-b32d-d49e1d2f34c1 with Priority: HIGHEST for action security_group_members [ 754.693355] env[69232]: INFO networking_nsxv3.common.synchronization [req-7834c1b5-ba92-46b7-93b5-bfacf8696d11 req-3375dec3-e95b-4414-88c3-dbf43939567f service nova] Enqueued Resource ID: ce97a929-4294-4145-a93f-b32689dbbaec with Priority: HIGHEST for action port [ 754.694743] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e155778-3c23-43f6-a632-21f66a4311f8 in Status: IN_PROGRESS for 2s [ 754.695231] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 531d0f92-2e98-47df-b32d-d49e1d2f34c1 with Priority: HIGHEST for action security_group_rules [ 754.695430] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 531d0f92-2e98-47df-b32d-d49e1d2f34c1 with Priority: HIGHEST for action security_group_members [ 754.695564] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce97a929-4294-4145-a93f-b32689dbbaec with Priority: HIGHEST for action port [ 754.695855] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-531d0f92-2e98-47df-b32d-d49e1d2f34c1 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.696143] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-531d0f92-2e98-47df-b32d-d49e1d2f34c1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.696227] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-531d0f92-2e98-47df-b32d-d49e1d2f34c1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.696438] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-531d0f92-2e98-47df-b32d-d49e1d2f34c1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.696520] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('531d0f92-2e98-47df-b32d-d49e1d2f34c1',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.697881] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-531d0f92-2e98-47df-b32d-d49e1d2f34c1 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.697881] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-531d0f92-2e98-47df-b32d-d49e1d2f34c1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.697994] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-ce97a929-4294-4145-a93f-b32689dbbaec taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.698106] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ce97a929-4294-4145-a93f-b32689dbbaec" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.698143] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ce97a929-4294-4145-a93f-b32689dbbaec" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.698636] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ce97a929-4294-4145-a93f-b32689dbbaec" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.699018] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ce97a929-4294-4145-a93f-b32689dbbaec',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.202865] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ce97a929-4294-4145-a93f-b32689dbbaec with status ACTIVE [ 755.203232] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.203232] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.203532] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.203532] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.203596] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.203774] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.203873] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.203936] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.204107] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.204173] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.204353] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.204444] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.204505] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.204642] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.204716] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.204800] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ce97a929-4294-4145-a93f-b32689dbbaec is going to be updated. [ 755.206393] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-531d0f92-2e98-47df-b32d-d49e1d2f34c1 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.206502] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-531d0f92-2e98-47df-b32d-d49e1d2f34c1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.242026] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.242026] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.242026] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.242026] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.242026] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.242026] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ce97a929-4294-4145-a93f-b32689dbbaec" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.390103] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a45a455-673b-417d-b2f6-be9352c2077e in Status: SUCCESS [ 755.390315] env[69232]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5a45a455-673b-417d-b2f6-be9352c2077e deletion is rescheduled due to dependency. [ 755.390469] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a45a455-673b-417d-b2f6-be9352c2077e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.893534] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 24c49db3-d2db-437b-976f-e83851ddd42c in Status: SUCCESS [ 755.893841] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-24c49db3-d2db-437b-976f-e83851ddd42c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.266187] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 531d0f92-2e98-47df-b32d-d49e1d2f34c1 in Status: SUCCESS [ 756.266187] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-531d0f92-2e98-47df-b32d-d49e1d2f34c1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.266651] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-531d0f92-2e98-47df-b32d-d49e1d2f34c1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.266651] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-531d0f92-2e98-47df-b32d-d49e1d2f34c1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.266858] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.267299] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.267623] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.267697] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.267768] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.267920] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('531d0f92-2e98-47df-b32d-d49e1d2f34c1',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.582021] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 393d1484-2236-4219-a1eb-b4013eec039a in Status: SUCCESS [ 756.582454] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-393d1484-2236-4219-a1eb-b4013eec039a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.582504] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-393d1484-2236-4219-a1eb-b4013eec039a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.582729] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-393d1484-2236-4219-a1eb-b4013eec039a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.582935] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.583115] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.583186] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.583360] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.583509] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.583571] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-393d1484-2236-4219-a1eb-b4013eec039a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.583620] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('393d1484-2236-4219-a1eb-b4013eec039a',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.587064] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-393d1484-2236-4219-a1eb-b4013eec039a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.587333] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-393d1484-2236-4219-a1eb-b4013eec039a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.587554] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.588846] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.588955] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.589218] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.589390] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.589390] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('393d1484-2236-4219-a1eb-b4013eec039a',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.706523] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e155778-3c23-43f6-a632-21f66a4311f8 in Status: SUCCESS [ 756.706822] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e155778-3c23-43f6-a632-21f66a4311f8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.706931] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e155778-3c23-43f6-a632-21f66a4311f8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.707181] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e155778-3c23-43f6-a632-21f66a4311f8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.707371] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.707494] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.708105] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.708105] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.708105] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.708105] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5e155778-3c23-43f6-a632-21f66a4311f8',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.770585] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('531d0f92-2e98-47df-b32d-d49e1d2f34c1',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.088187] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('393d1484-2236-4219-a1eb-b4013eec039a',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.091857] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('393d1484-2236-4219-a1eb-b4013eec039a',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.210855] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.211090] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.211163] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.211389] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.211483] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.211698] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.211801] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.211864] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.212276] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.212276] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.212276] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e155778-3c23-43f6-a632-21f66a4311f8 is going to be updated. [ 757.248371] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.248371] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.248371] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.248371] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.248371] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.262274] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e155778-3c23-43f6-a632-21f66a4311f8 in Status: IN_PROGRESS for 2s [ 757.273314] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('531d0f92-2e98-47df-b32d-d49e1d2f34c1',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.518158] env[69232]: INFO networking_nsxv3.common.synchronization [req-769cd436-4710-4fcc-aee6-2f0d6295f9a2 req-1cd8be51-b435-42aa-8276-2d73beb03ce7 tempest-AttachInterfacesUnderV243Test-115986106 tempest-AttachInterfacesUnderV243Test-115986106-project-member] Enqueued Resource ID: 393d1484-2236-4219-a1eb-b4013eec039a with Priority: HIGHEST for action security_group_members [ 757.519327] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 393d1484-2236-4219-a1eb-b4013eec039a with Priority: HIGHEST for action security_group_members [ 757.519327] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-393d1484-2236-4219-a1eb-b4013eec039a taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.520955] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-393d1484-2236-4219-a1eb-b4013eec039a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.591473] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 393d1484-2236-4219-a1eb-b4013eec039a: rpc.has_security_group_logging(os_id): False [ 757.593633] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('393d1484-2236-4219-a1eb-b4013eec039a',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.610639] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.610815] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.610882] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.611125] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.611221] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.611491] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.611591] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.611657] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.611813] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.612086] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.612086] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 393d1484-2236-4219-a1eb-b4013eec039a is going to be updated. [ 757.694276] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.694276] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.694276] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.694276] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.694276] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.709528] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 393d1484-2236-4219-a1eb-b4013eec039a in Status: IN_PROGRESS for 2s [ 757.777323] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.777527] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.777688] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.778129] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.778129] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.778129] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 531d0f92-2e98-47df-b32d-d49e1d2f34c1 is going to be updated. [ 757.817974] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.818179] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.818266] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.818473] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.818631] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.843324] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 531d0f92-2e98-47df-b32d-d49e1d2f34c1 in Status: IN_PROGRESS for 2s [ 758.096418] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.096789] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.096789] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.097244] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.097244] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.097388] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 393d1484-2236-4219-a1eb-b4013eec039a is going to be updated. [ 758.140227] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.140227] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.140227] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.140451] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.140679] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.157856] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 393d1484-2236-4219-a1eb-b4013eec039a in Status: IN_PROGRESS for 2s [ 759.271855] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e155778-3c23-43f6-a632-21f66a4311f8 in Status: SUCCESS [ 759.271855] env[69232]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e155778-3c23-43f6-a632-21f66a4311f8 deletion is rescheduled due to dependency. [ 759.271855] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e155778-3c23-43f6-a632-21f66a4311f8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.271855] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e155778-3c23-43f6-a632-21f66a4311f8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.275017] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e155778-3c23-43f6-a632-21f66a4311f8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.275017] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.275017] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.275017] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.275017] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.275017] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.275017] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5e155778-3c23-43f6-a632-21f66a4311f8',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.374071] env[69232]: INFO networking_nsxv3.common.synchronization [req-f90d55b6-8408-4cdd-8f8f-3f64074f6d2d req-4cfa1b71-752f-4340-8ba1-6c0950e64b67 tempest-ServerAddressesNegativeTestJSON-1184128985 tempest-ServerAddressesNegativeTestJSON-1184128985-project-member] Enqueued Resource ID: 70f65c0d-8fd1-4807-94b2-0a9403b8c3d4 with Priority: HIGHEST for action security_group_members [ 759.374071] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70f65c0d-8fd1-4807-94b2-0a9403b8c3d4 with Priority: HIGHEST for action security_group_members [ 759.374278] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-70f65c0d-8fd1-4807-94b2-0a9403b8c3d4 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.374415] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-70f65c0d-8fd1-4807-94b2-0a9403b8c3d4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.374672] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-70f65c0d-8fd1-4807-94b2-0a9403b8c3d4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.374905] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-70f65c0d-8fd1-4807-94b2-0a9403b8c3d4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.375079] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.375180] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.375243] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.375391] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.375479] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.375571] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('70f65c0d-8fd1-4807-94b2-0a9403b8c3d4',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.629756] env[69232]: INFO networking_nsxv3.common.synchronization [None req-b09106c4-f303-4c8c-b1aa-50301b2d3ce8 None None] Enqueued Resource ID: 932cf7f1-908a-4a87-a37f-f4182f7f5739 with Priority: HIGHEST for action port [ 759.630452] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 932cf7f1-908a-4a87-a37f-f4182f7f5739 with Priority: HIGHEST for action port [ 759.630748] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-932cf7f1-908a-4a87-a37f-f4182f7f5739 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.630887] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-932cf7f1-908a-4a87-a37f-f4182f7f5739" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.631561] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-932cf7f1-908a-4a87-a37f-f4182f7f5739" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.631857] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-932cf7f1-908a-4a87-a37f-f4182f7f5739" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.631980] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('932cf7f1-908a-4a87-a37f-f4182f7f5739',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.742636] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 393d1484-2236-4219-a1eb-b4013eec039a in Status: SUCCESS [ 759.746026] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-393d1484-2236-4219-a1eb-b4013eec039a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.746026] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-393d1484-2236-4219-a1eb-b4013eec039a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.746026] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-393d1484-2236-4219-a1eb-b4013eec039a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.746026] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('393d1484-2236-4219-a1eb-b4013eec039a',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.780023] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.780023] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.780023] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.780023] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.780023] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.780023] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.780023] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.780023] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.780023] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.780023] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.780023] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e155778-3c23-43f6-a632-21f66a4311f8 is going to be updated. [ 759.821880] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.822106] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.822106] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.822443] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.822443] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.844708] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e155778-3c23-43f6-a632-21f66a4311f8 in Status: IN_PROGRESS for 2s [ 759.864574] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 531d0f92-2e98-47df-b32d-d49e1d2f34c1 in Status: SUCCESS [ 759.864828] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-531d0f92-2e98-47df-b32d-d49e1d2f34c1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.865018] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-531d0f92-2e98-47df-b32d-d49e1d2f34c1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.865289] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-531d0f92-2e98-47df-b32d-d49e1d2f34c1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.865498] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.865626] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.865694] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.865880] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.865983] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.866098] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-531d0f92-2e98-47df-b32d-d49e1d2f34c1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.866203] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('531d0f92-2e98-47df-b32d-d49e1d2f34c1',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.878417] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.878591] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.878647] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.878891] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.879014] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.879232] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.879332] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.879395] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.880408] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.880408] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.880482] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 70f65c0d-8fd1-4807-94b2-0a9403b8c3d4 is going to be updated. [ 759.928146] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.932041] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.932041] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.932041] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.932041] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.943305] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 70f65c0d-8fd1-4807-94b2-0a9403b8c3d4 in Status: IN_PROGRESS for 2s [ 760.136421] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 932cf7f1-908a-4a87-a37f-f4182f7f5739 [ 760.136683] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.136819] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.136887] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.137124] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.137214] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.137307] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:932cf7f1-908a-4a87-a37f-f4182f7f5739 already deleted. [ 760.137386] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-932cf7f1-908a-4a87-a37f-f4182f7f5739" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.189452] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 393d1484-2236-4219-a1eb-b4013eec039a in Status: SUCCESS [ 760.189666] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-393d1484-2236-4219-a1eb-b4013eec039a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.189802] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-393d1484-2236-4219-a1eb-b4013eec039a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.190095] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-393d1484-2236-4219-a1eb-b4013eec039a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.190305] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.190429] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.190494] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.190649] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.190733] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.190828] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('393d1484-2236-4219-a1eb-b4013eec039a',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.267410] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.267667] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.267667] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.268073] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.268073] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.268287] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 393d1484-2236-4219-a1eb-b4013eec039a is going to be deleted. [ 760.333057] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.333576] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.333576] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.333576] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.333576] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.333805] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-393d1484-2236-4219-a1eb-b4013eec039a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.377010] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-531d0f92-2e98-47df-b32d-d49e1d2f34c1 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.377010] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-531d0f92-2e98-47df-b32d-d49e1d2f34c1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.377010] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-531d0f92-2e98-47df-b32d-d49e1d2f34c1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.377010] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-531d0f92-2e98-47df-b32d-d49e1d2f34c1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.377010] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.377010] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.377010] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.377010] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.377010] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.377010] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-531d0f92-2e98-47df-b32d-d49e1d2f34c1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.377010] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-531d0f92-2e98-47df-b32d-d49e1d2f34c1 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.377010] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-531d0f92-2e98-47df-b32d-d49e1d2f34c1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.377010] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-531d0f92-2e98-47df-b32d-d49e1d2f34c1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.377010] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-531d0f92-2e98-47df-b32d-d49e1d2f34c1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.377010] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.377010] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.382228] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.382228] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.382228] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.382228] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-531d0f92-2e98-47df-b32d-d49e1d2f34c1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.382228] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('531d0f92-2e98-47df-b32d-d49e1d2f34c1',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.615703] env[69232]: INFO networking_nsxv3.common.synchronization [req-1cd66a77-9b96-445e-ae54-5989daa8e400 req-5b88ca2f-c9ad-454e-8ac3-d6bb3eae3b9e tempest-DeleteServersTestJSON-830271628 tempest-DeleteServersTestJSON-830271628-project-member] Enqueued Resource ID: 9f5186e6-2d35-4ccf-a8b4-749a0a872128 with Priority: HIGHEST for action security_group_members [ 760.620153] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f5186e6-2d35-4ccf-a8b4-749a0a872128 with Priority: HIGHEST for action security_group_members [ 760.620709] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f5186e6-2d35-4ccf-a8b4-749a0a872128 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.620823] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.620891] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.621176] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.621328] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.621520] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.621520] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.621719] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.621719] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.621802] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9f5186e6-2d35-4ccf-a8b4-749a0a872128',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.695533] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.696136] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.696136] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.696136] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.696136] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.696318] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.696492] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.696492] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.697475] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.697475] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.697475] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 393d1484-2236-4219-a1eb-b4013eec039a is going to be deleted. [ 760.735342] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.735342] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.735342] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.735342] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.735342] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.735342] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-393d1484-2236-4219-a1eb-b4013eec039a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.735342] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-393d1484-2236-4219-a1eb-b4013eec039a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.735342] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-393d1484-2236-4219-a1eb-b4013eec039a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.735342] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.735342] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.735342] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.735342] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.735342] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.735342] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('393d1484-2236-4219-a1eb-b4013eec039a',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.879575] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 531d0f92-2e98-47df-b32d-d49e1d2f34c1: rpc.has_security_group_logging(os_id): False [ 760.900273] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.900425] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.900484] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.903841] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.904049] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.904320] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.904440] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.904518] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.904720] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.904775] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.904939] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.905077] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.905162] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.905251] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.905326] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.905540] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.905672] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.905938] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.906121] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.906202] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.906281] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 531d0f92-2e98-47df-b32d-d49e1d2f34c1 is going to be updated. [ 760.977822] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.977989] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.978113] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.978533] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.978773] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.002044] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 531d0f92-2e98-47df-b32d-d49e1d2f34c1 in Status: IN_PROGRESS for 2s [ 761.125588] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.125588] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.125588] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.125588] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.125588] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.125588] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.125588] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.125588] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.125588] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.125588] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.125588] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9f5186e6-2d35-4ccf-a8b4-749a0a872128 already deleted. [ 761.125588] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.239822] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.239822] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.239822] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.239822] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.239822] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.239822] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.239822] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.239822] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.239822] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.239822] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.239822] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 393d1484-2236-4219-a1eb-b4013eec039a already deleted. [ 761.239822] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-393d1484-2236-4219-a1eb-b4013eec039a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.739036] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock network-279 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.739036] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "network-279" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.739036] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "network-279" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.739036] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "network-279" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.741736] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.741981] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.742126] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.742469] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.742783] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.742893] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 761.743017] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] NeedRegenerationException {{(pid=69232) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 761.743118] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] no value, waiting for create lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 761.743222] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] value creation lock acquired {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 761.743330] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 761.743436] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Calling creation function for not-yet-present value {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 761.743704] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 761.766780] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 761.767014] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69232) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 761.767194] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Released creation lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 761.767399] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "network-279" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.767775] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock port-3f9a0b17-2584-48bc-90df-498255e2bcf9 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.767972] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "port-3f9a0b17-2584-48bc-90df-498255e2bcf9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.768299] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "port-3f9a0b17-2584-48bc-90df-498255e2bcf9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.768559] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "port-3f9a0b17-2584-48bc-90df-498255e2bcf9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.768721] env[69232]: DEBUG networking_nsxv3.api.rpc [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3f9a0b17-2584-48bc-90df-498255e2bcf9',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.854070] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e155778-3c23-43f6-a632-21f66a4311f8 in Status: SUCCESS [ 761.854340] env[69232]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e155778-3c23-43f6-a632-21f66a4311f8 deletion is rescheduled due to dependency. [ 761.854454] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e155778-3c23-43f6-a632-21f66a4311f8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.954197] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 70f65c0d-8fd1-4807-94b2-0a9403b8c3d4 in Status: SUCCESS [ 761.954731] env[69232]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 70f65c0d-8fd1-4807-94b2-0a9403b8c3d4 deletion is rescheduled due to dependency. [ 761.954984] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-70f65c0d-8fd1-4807-94b2-0a9403b8c3d4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.273851] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.274460] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.277865] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.277865] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.277865] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.277865] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Segment Port 3f9a0b17-2584-48bc-90df-498255e2bcf9 not found, creating... [ 762.277865] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.277865] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.277865] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.277865] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.277865] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.277865] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.278840] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.278840] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.278840] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.279314] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.280158] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Resource: SegmentPort with ID: 3f9a0b17-2584-48bc-90df-498255e2bcf9 is going to be created. [ 762.304182] env[69232]: INFO networking_nsxv3.common.synchronization [None req-bb89357a-2739-4d63-ba65-e54ed4a02ead tempest-AttachVolumeShelveTestJSON-303748050 tempest-AttachVolumeShelveTestJSON-303748050-project-member] Enqueued Resource ID: 9ea0b8f1-7dc8-48fd-bd49-a3ae8c7a9645 with Priority: HIGHEST for action security_group_rules [ 762.304960] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.305348] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.305577] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.305932] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.306400] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.306747] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "port-3f9a0b17-2584-48bc-90df-498255e2bcf9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.307922] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ea0b8f1-7dc8-48fd-bd49-a3ae8c7a9645 with Priority: HIGHEST for action security_group_rules [ 762.308630] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9ea0b8f1-7dc8-48fd-bd49-a3ae8c7a9645 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.309078] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9ea0b8f1-7dc8-48fd-bd49-a3ae8c7a9645" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.309250] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9ea0b8f1-7dc8-48fd-bd49-a3ae8c7a9645" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.310355] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9ea0b8f1-7dc8-48fd-bd49-a3ae8c7a9645" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.310464] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9ea0b8f1-7dc8-48fd-bd49-a3ae8c7a9645',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.430142] env[69232]: INFO networking_nsxv3.common.synchronization [None req-c6cfa148-9881-424d-8312-8eaddbc19fe6 tempest-AttachVolumeShelveTestJSON-303748050 tempest-AttachVolumeShelveTestJSON-303748050-project-member] Enqueued Resource ID: 9ea0b8f1-7dc8-48fd-bd49-a3ae8c7a9645 with Priority: HIGHEST for action security_group_rules [ 762.430878] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ea0b8f1-7dc8-48fd-bd49-a3ae8c7a9645 with Priority: HIGHEST for action security_group_rules [ 762.431555] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9ea0b8f1-7dc8-48fd-bd49-a3ae8c7a9645 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.431555] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9ea0b8f1-7dc8-48fd-bd49-a3ae8c7a9645" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.684126] env[69232]: INFO networking_nsxv3.common.synchronization [None req-1f02af8a-7601-4bcf-93bc-7a0f414315da None None] Enqueued Resource ID: a3d957c3-ebec-4181-9812-12b0e1dc3f5f with Priority: HIGHEST for action port [ 762.684433] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3d957c3-ebec-4181-9812-12b0e1dc3f5f with Priority: HIGHEST for action port [ 762.684792] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-a3d957c3-ebec-4181-9812-12b0e1dc3f5f taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.684916] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a3d957c3-ebec-4181-9812-12b0e1dc3f5f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.684974] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a3d957c3-ebec-4181-9812-12b0e1dc3f5f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.685255] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a3d957c3-ebec-4181-9812-12b0e1dc3f5f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.685341] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a3d957c3-ebec-4181-9812-12b0e1dc3f5f',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.739745] env[69232]: INFO networking_nsxv3.common.synchronization [None req-51a3878a-e20b-44bf-a3ee-5fa51f67d04c None None] Enqueued Resource ID: 3bdb1a33-f2d2-481f-9ab6-a47196a42c4b with Priority: HIGHEST for action port [ 762.740092] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bdb1a33-f2d2-481f-9ab6-a47196a42c4b with Priority: HIGHEST for action port [ 762.740632] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-3bdb1a33-f2d2-481f-9ab6-a47196a42c4b taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.740777] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3bdb1a33-f2d2-481f-9ab6-a47196a42c4b" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.740818] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3bdb1a33-f2d2-481f-9ab6-a47196a42c4b" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.741174] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3bdb1a33-f2d2-481f-9ab6-a47196a42c4b" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.741251] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3bdb1a33-f2d2-481f-9ab6-a47196a42c4b',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.840092] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.842954] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.842954] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.842954] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.842954] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.842954] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9ea0b8f1-7dc8-48fd-bd49-a3ae8c7a9645 already deleted. [ 762.842954] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9ea0b8f1-7dc8-48fd-bd49-a3ae8c7a9645" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.842954] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9ea0b8f1-7dc8-48fd-bd49-a3ae8c7a9645" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.842954] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9ea0b8f1-7dc8-48fd-bd49-a3ae8c7a9645" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.842954] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9ea0b8f1-7dc8-48fd-bd49-a3ae8c7a9645',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.015802] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 531d0f92-2e98-47df-b32d-d49e1d2f34c1 in Status: SUCCESS [ 763.015802] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-531d0f92-2e98-47df-b32d-d49e1d2f34c1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.189229] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a3d957c3-ebec-4181-9812-12b0e1dc3f5f [ 763.189229] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.189385] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.189385] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.189847] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.189847] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.189847] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a3d957c3-ebec-4181-9812-12b0e1dc3f5f already deleted. [ 763.189847] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a3d957c3-ebec-4181-9812-12b0e1dc3f5f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.244509] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3bdb1a33-f2d2-481f-9ab6-a47196a42c4b [ 763.244509] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.244735] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.244735] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.245296] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.245296] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.245296] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3bdb1a33-f2d2-481f-9ab6-a47196a42c4b already deleted. [ 763.245296] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3bdb1a33-f2d2-481f-9ab6-a47196a42c4b" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.366177] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.366177] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.366177] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.366177] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.366177] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.366177] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9ea0b8f1-7dc8-48fd-bd49-a3ae8c7a9645 already deleted. [ 763.366177] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9ea0b8f1-7dc8-48fd-bd49-a3ae8c7a9645" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.425057] env[69232]: INFO networking_nsxv3.common.synchronization [req-1cd66a77-9b96-445e-ae54-5989daa8e400 req-6563fcbd-c5a6-431b-9b9d-c210fba38445 service nova] Enqueued Resource ID: 9f5186e6-2d35-4ccf-a8b4-749a0a872128 with Priority: HIGHEST for action security_group_rules [ 763.425057] env[69232]: INFO networking_nsxv3.common.synchronization [req-1cd66a77-9b96-445e-ae54-5989daa8e400 req-6563fcbd-c5a6-431b-9b9d-c210fba38445 service nova] Enqueued Resource ID: 9f5186e6-2d35-4ccf-a8b4-749a0a872128 with Priority: HIGHEST for action security_group_members [ 763.425057] env[69232]: INFO networking_nsxv3.common.synchronization [req-1cd66a77-9b96-445e-ae54-5989daa8e400 req-6563fcbd-c5a6-431b-9b9d-c210fba38445 service nova] Enqueued Resource ID: 3f9a0b17-2584-48bc-90df-498255e2bcf9 with Priority: HIGHEST for action port [ 763.425057] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f5186e6-2d35-4ccf-a8b4-749a0a872128 with Priority: HIGHEST for action security_group_rules [ 763.425057] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f5186e6-2d35-4ccf-a8b4-749a0a872128 with Priority: HIGHEST for action security_group_members [ 763.425057] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f9a0b17-2584-48bc-90df-498255e2bcf9 with Priority: HIGHEST for action port [ 763.426246] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9f5186e6-2d35-4ccf-a8b4-749a0a872128 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.426518] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.426671] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.427060] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.427556] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9f5186e6-2d35-4ccf-a8b4-749a0a872128',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.428591] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f5186e6-2d35-4ccf-a8b4-749a0a872128 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.430028] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.430028] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.430028] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.430028] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.430028] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.430028] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.430028] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.430028] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.430028] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9f5186e6-2d35-4ccf-a8b4-749a0a872128',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.431040] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-3f9a0b17-2584-48bc-90df-498255e2bcf9 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.431579] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3f9a0b17-2584-48bc-90df-498255e2bcf9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.431734] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3f9a0b17-2584-48bc-90df-498255e2bcf9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.431983] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3f9a0b17-2584-48bc-90df-498255e2bcf9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.432160] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3f9a0b17-2584-48bc-90df-498255e2bcf9',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.935013] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9f5186e6-2d35-4ccf-a8b4-749a0a872128',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.938309] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f5186e6-2d35-4ccf-a8b4-749a0a872128 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.938309] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.938309] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3f9a0b17-2584-48bc-90df-498255e2bcf9 with status ACTIVE [ 763.938309] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.938309] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.938309] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.938309] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.938309] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.938309] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.938309] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.938309] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.938309] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.938309] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.938309] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.938855] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.938855] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.939343] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.939415] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.939508] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3f9a0b17-2584-48bc-90df-498255e2bcf9 is going to be updated. [ 763.965824] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.965993] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.966080] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.966297] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.966433] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.966593] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3f9a0b17-2584-48bc-90df-498255e2bcf9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.441577] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9f5186e6-2d35-4ccf-a8b4-749a0a872128',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.796386] env[69232]: INFO networking_nsxv3.common.synchronization [None req-38a4d68e-1643-400a-ba29-0ae743a7332e None None] Enqueued Resource ID: 0dec1758-c67d-484b-965d-ee5e8ffbcf72 with Priority: HIGHEST for action port [ 764.797058] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0dec1758-c67d-484b-965d-ee5e8ffbcf72 with Priority: HIGHEST for action port [ 764.798329] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-0dec1758-c67d-484b-965d-ee5e8ffbcf72 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.798329] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0dec1758-c67d-484b-965d-ee5e8ffbcf72" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.798329] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0dec1758-c67d-484b-965d-ee5e8ffbcf72" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.798329] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0dec1758-c67d-484b-965d-ee5e8ffbcf72" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.798329] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0dec1758-c67d-484b-965d-ee5e8ffbcf72',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.942086] env[69232]: INFO networking_nsxv3.common.synchronization [None req-c976ff5f-93b2-4eeb-a4ab-ff540b69ba89 None None] Enqueued Resource ID: 4eb6ee0d-aae5-44cb-a301-5c0dbd7bbb0e with Priority: HIGHEST for action port [ 764.942086] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4eb6ee0d-aae5-44cb-a301-5c0dbd7bbb0e with Priority: HIGHEST for action port [ 764.942086] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-4eb6ee0d-aae5-44cb-a301-5c0dbd7bbb0e taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.942086] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4eb6ee0d-aae5-44cb-a301-5c0dbd7bbb0e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.942086] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4eb6ee0d-aae5-44cb-a301-5c0dbd7bbb0e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.942086] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4eb6ee0d-aae5-44cb-a301-5c0dbd7bbb0e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.942086] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4eb6ee0d-aae5-44cb-a301-5c0dbd7bbb0e',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.946364] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.949226] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.949226] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.949226] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.949226] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.949226] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9f5186e6-2d35-4ccf-a8b4-749a0a872128 is going to be created. [ 764.975503] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.975503] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.975503] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.975503] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.975503] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.987137] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f5186e6-2d35-4ccf-a8b4-749a0a872128 in Status: UNINITIALIZED for 2s [ 765.302911] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0dec1758-c67d-484b-965d-ee5e8ffbcf72 [ 765.303180] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.303344] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.303393] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.303570] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.303663] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.303756] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0dec1758-c67d-484b-965d-ee5e8ffbcf72 already deleted. [ 765.303840] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0dec1758-c67d-484b-965d-ee5e8ffbcf72" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.445464] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4eb6ee0d-aae5-44cb-a301-5c0dbd7bbb0e [ 765.445823] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.446153] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.446494] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.446884] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.447101] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.447316] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4eb6ee0d-aae5-44cb-a301-5c0dbd7bbb0e already deleted. [ 765.447527] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4eb6ee0d-aae5-44cb-a301-5c0dbd7bbb0e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.009263] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f5186e6-2d35-4ccf-a8b4-749a0a872128 in Status: SUCCESS [ 767.009594] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.009864] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.010172] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.010402] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.010528] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.010586] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.010760] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.010839] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.010921] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.011022] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9f5186e6-2d35-4ccf-a8b4-749a0a872128',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.346721] env[69232]: INFO networking_nsxv3.common.synchronization [req-d1dcf1a2-29c0-4201-93f6-e53a4b7ebabe req-fb3976ef-845b-4651-a318-ced09a5a3b5e tempest-ImagesOneServerNegativeTestJSON-501782696 tempest-ImagesOneServerNegativeTestJSON-501782696-project-member] Enqueued Resource ID: 6e7bf0fa-24cf-40f7-ac38-1adabda5207c with Priority: HIGHEST for action security_group_members [ 767.348254] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e7bf0fa-24cf-40f7-ac38-1adabda5207c with Priority: HIGHEST for action security_group_members [ 767.348254] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e7bf0fa-24cf-40f7-ac38-1adabda5207c taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.348254] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e7bf0fa-24cf-40f7-ac38-1adabda5207c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.348254] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e7bf0fa-24cf-40f7-ac38-1adabda5207c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.348254] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e7bf0fa-24cf-40f7-ac38-1adabda5207c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.348254] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.348564] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.348564] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.348564] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.348643] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.348674] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6e7bf0fa-24cf-40f7-ac38-1adabda5207c',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.516965] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f5186e6-2d35-4ccf-a8b4-749a0a872128 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.517374] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.517374] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.517521] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.517768] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.517893] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.517937] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.518112] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.518202] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.518291] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.518438] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f5186e6-2d35-4ccf-a8b4-749a0a872128 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.518557] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.518658] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.518893] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.518893] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.518991] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.518991] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.519127] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.519201] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.519281] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.519371] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9f5186e6-2d35-4ccf-a8b4-749a0a872128',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.837207] env[69232]: INFO networking_nsxv3.common.synchronization [None req-5b056796-182d-4961-a342-89c2bb4fe297 None None] Enqueued Resource ID: e93d2b47-e4a4-45e2-8670-1963e23fa44a with Priority: HIGHEST for action port [ 767.837475] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e93d2b47-e4a4-45e2-8670-1963e23fa44a with Priority: HIGHEST for action port [ 767.838091] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-e93d2b47-e4a4-45e2-8670-1963e23fa44a taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.838236] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e93d2b47-e4a4-45e2-8670-1963e23fa44a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.838236] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e93d2b47-e4a4-45e2-8670-1963e23fa44a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.838484] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e93d2b47-e4a4-45e2-8670-1963e23fa44a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.838564] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e93d2b47-e4a4-45e2-8670-1963e23fa44a',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.850337] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.850484] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.850586] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.850746] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.850863] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.851019] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.851123] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.851175] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.851331] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.851412] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.851498] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e7bf0fa-24cf-40f7-ac38-1adabda5207c is going to be updated. [ 767.882658] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.882658] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.882658] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.882658] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.882658] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.889834] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e7bf0fa-24cf-40f7-ac38-1adabda5207c in Status: IN_PROGRESS for 2s [ 768.021500] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9f5186e6-2d35-4ccf-a8b4-749a0a872128: rpc.has_security_group_logging(os_id): False [ 768.039295] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.039437] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.039437] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.039708] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.039920] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.039920] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.040072] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.040120] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.040268] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.040350] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.040539] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.040623] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.040703] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.040824] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.040897] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.041125] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.041240] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.041319] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.041411] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.041483] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.041570] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9f5186e6-2d35-4ccf-a8b4-749a0a872128 is going to be created. [ 768.150045] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.150045] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.150045] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.150045] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.150045] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.176285] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9f5186e6-2d35-4ccf-a8b4-749a0a872128 in Status: IN_PROGRESS for 2s [ 768.341693] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e93d2b47-e4a4-45e2-8670-1963e23fa44a [ 768.341990] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.342349] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.342349] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.342601] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.342702] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.342816] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e93d2b47-e4a4-45e2-8670-1963e23fa44a already deleted. [ 768.342924] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e93d2b47-e4a4-45e2-8670-1963e23fa44a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.899168] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e7bf0fa-24cf-40f7-ac38-1adabda5207c in Status: SUCCESS [ 769.899521] env[69232]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e7bf0fa-24cf-40f7-ac38-1adabda5207c deletion is rescheduled due to dependency. [ 769.899521] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e7bf0fa-24cf-40f7-ac38-1adabda5207c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.190492] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9f5186e6-2d35-4ccf-a8b4-749a0a872128 in Status: SUCCESS [ 770.190728] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.705760] env[69232]: INFO networking_nsxv3.common.synchronization [req-0fa6606d-4ebe-4d26-adc2-d4c5ae78de0d req-5c6f7b43-7436-435d-adc1-bcf3d2345171 tempest-ServerActionsTestJSON-973196373 tempest-ServerActionsTestJSON-973196373-project-member] Enqueued Resource ID: 1eb9f24d-331e-450b-9da0-82652ecba032 with Priority: HIGHEST for action security_group_members [ 770.706657] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1eb9f24d-331e-450b-9da0-82652ecba032 with Priority: HIGHEST for action security_group_members [ 770.706751] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-1eb9f24d-331e-450b-9da0-82652ecba032 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.706836] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1eb9f24d-331e-450b-9da0-82652ecba032" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.706900] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1eb9f24d-331e-450b-9da0-82652ecba032" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.707219] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1eb9f24d-331e-450b-9da0-82652ecba032" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.707408] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.707528] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.707590] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.707748] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.707833] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.707941] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1eb9f24d-331e-450b-9da0-82652ecba032',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.198657] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock network-892 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.199510] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "network-892" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.199761] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "network-892" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.200235] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "network-892" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.200748] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.201096] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.203019] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.203019] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.203019] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.203019] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 771.203019] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] NeedRegenerationException {{(pid=69232) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 771.203019] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] no value, waiting for create lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 771.203019] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] value creation lock acquired {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 771.203019] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 771.203019] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Calling creation function for not-yet-present value {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 771.203019] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 771.211507] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.211507] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.211507] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.211507] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.211507] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.211507] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.211507] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.211507] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.211507] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.211507] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.211507] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1eb9f24d-331e-450b-9da0-82652ecba032 already deleted. [ 771.211507] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1eb9f24d-331e-450b-9da0-82652ecba032" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.233592] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 771.236020] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Cache value generated in 0.031 seconds for key(s): 'zone-id' {{(pid=69232) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 771.236020] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Released creation lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 771.236020] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "network-892" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.236020] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock port-953bbfca-0d3b-49dc-8e71-cf2f233875c3 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.236020] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "port-953bbfca-0d3b-49dc-8e71-cf2f233875c3" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.236020] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "port-953bbfca-0d3b-49dc-8e71-cf2f233875c3" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.236020] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "port-953bbfca-0d3b-49dc-8e71-cf2f233875c3" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.236020] env[69232]: DEBUG networking_nsxv3.api.rpc [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('953bbfca-0d3b-49dc-8e71-cf2f233875c3',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.741066] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.741316] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.741507] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.741820] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.741884] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.742059] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Segment Port 953bbfca-0d3b-49dc-8e71-cf2f233875c3 not found, creating... [ 771.742341] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.742494] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.742610] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.742844] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.743493] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.743493] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.743493] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.743715] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.743812] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.743948] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.744132] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Resource: SegmentPort with ID: 953bbfca-0d3b-49dc-8e71-cf2f233875c3 is going to be created. [ 771.772682] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.772955] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.773090] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.775038] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.775038] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.776037] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "port-953bbfca-0d3b-49dc-8e71-cf2f233875c3" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.563185] env[69232]: INFO networking_nsxv3.common.synchronization [req-0fa6606d-4ebe-4d26-adc2-d4c5ae78de0d req-1e98dc5f-5994-43e0-8fcf-1ef78b73d6ab service nova] Enqueued Resource ID: 1eb9f24d-331e-450b-9da0-82652ecba032 with Priority: HIGHEST for action security_group_rules [ 772.563185] env[69232]: INFO networking_nsxv3.common.synchronization [req-0fa6606d-4ebe-4d26-adc2-d4c5ae78de0d req-1e98dc5f-5994-43e0-8fcf-1ef78b73d6ab service nova] Enqueued Resource ID: 1eb9f24d-331e-450b-9da0-82652ecba032 with Priority: HIGHEST for action security_group_members [ 772.563185] env[69232]: INFO networking_nsxv3.common.synchronization [req-0fa6606d-4ebe-4d26-adc2-d4c5ae78de0d req-1e98dc5f-5994-43e0-8fcf-1ef78b73d6ab service nova] Enqueued Resource ID: 953bbfca-0d3b-49dc-8e71-cf2f233875c3 with Priority: HIGHEST for action port [ 772.563185] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1eb9f24d-331e-450b-9da0-82652ecba032 with Priority: HIGHEST for action security_group_rules [ 772.563185] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1eb9f24d-331e-450b-9da0-82652ecba032 with Priority: HIGHEST for action security_group_members [ 772.563185] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 953bbfca-0d3b-49dc-8e71-cf2f233875c3 with Priority: HIGHEST for action port [ 772.563185] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1eb9f24d-331e-450b-9da0-82652ecba032 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.565472] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1eb9f24d-331e-450b-9da0-82652ecba032" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.565472] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1eb9f24d-331e-450b-9da0-82652ecba032" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.565472] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1eb9f24d-331e-450b-9da0-82652ecba032" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.565472] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1eb9f24d-331e-450b-9da0-82652ecba032',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.567121] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-1eb9f24d-331e-450b-9da0-82652ecba032 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.567218] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1eb9f24d-331e-450b-9da0-82652ecba032" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.567256] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1eb9f24d-331e-450b-9da0-82652ecba032" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.567433] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1eb9f24d-331e-450b-9da0-82652ecba032" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.567581] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.567699] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.567745] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.567855] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.567990] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.568848] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1eb9f24d-331e-450b-9da0-82652ecba032',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.568951] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-953bbfca-0d3b-49dc-8e71-cf2f233875c3 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.569068] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-953bbfca-0d3b-49dc-8e71-cf2f233875c3" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.569134] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-953bbfca-0d3b-49dc-8e71-cf2f233875c3" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.569283] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-953bbfca-0d3b-49dc-8e71-cf2f233875c3" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.569361] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('953bbfca-0d3b-49dc-8e71-cf2f233875c3',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.074635] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-1eb9f24d-331e-450b-9da0-82652ecba032 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.074782] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1eb9f24d-331e-450b-9da0-82652ecba032" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.074988] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1eb9f24d-331e-450b-9da0-82652ecba032',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.076062] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 953bbfca-0d3b-49dc-8e71-cf2f233875c3 with status ACTIVE [ 773.076322] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.076495] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.076638] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.076893] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.076993] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.077370] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.077526] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.077630] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.077838] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.078128] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.078682] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.079289] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.079611] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.080234] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.082139] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.082252] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 953bbfca-0d3b-49dc-8e71-cf2f233875c3 is going to be updated. [ 773.118092] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.118092] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.118092] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.118092] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.118092] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.118092] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-953bbfca-0d3b-49dc-8e71-cf2f233875c3" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.584403] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1eb9f24d-331e-450b-9da0-82652ecba032',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.644585] env[69232]: INFO networking_nsxv3.common.synchronization [req-3e99f7c0-104a-45a7-9e2b-a026836e88aa req-e17c17b7-8272-437a-8909-97dbf8612540 tempest-DeleteServersTestJSON-830271628 tempest-DeleteServersTestJSON-830271628-project-member] Enqueued Resource ID: 9f5186e6-2d35-4ccf-a8b4-749a0a872128 with Priority: HIGHEST for action security_group_members [ 773.644765] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f5186e6-2d35-4ccf-a8b4-749a0a872128 with Priority: HIGHEST for action security_group_members [ 773.645214] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f5186e6-2d35-4ccf-a8b4-749a0a872128 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.645391] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.645471] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.646035] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.646035] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.646035] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.646035] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.646393] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.646393] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.646393] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9f5186e6-2d35-4ccf-a8b4-749a0a872128',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.086478] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.086607] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.088490] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.088490] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.088490] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.088490] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1eb9f24d-331e-450b-9da0-82652ecba032 is going to be created. [ 774.119431] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.119623] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.119696] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.120258] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.120429] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.131975] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1eb9f24d-331e-450b-9da0-82652ecba032 in Status: UNINITIALIZED for 2s [ 774.148636] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.148784] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.148852] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.149075] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.149164] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.149347] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.149443] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.149529] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.149640] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.149731] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.149791] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9f5186e6-2d35-4ccf-a8b4-749a0a872128 is going to be updated. [ 774.185244] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.185349] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.185349] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.185909] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.186332] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.196989] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f5186e6-2d35-4ccf-a8b4-749a0a872128 in Status: IN_PROGRESS for 2s [ 774.252933] env[69232]: INFO networking_nsxv3.common.synchronization [None req-e442f532-f245-4e14-aaee-5a46febfb750 None None] Enqueued Resource ID: aa69cbad-50e9-4783-9cb9-437c5fd0507c with Priority: HIGHEST for action port [ 774.253214] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa69cbad-50e9-4783-9cb9-437c5fd0507c with Priority: HIGHEST for action port [ 774.253795] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-aa69cbad-50e9-4783-9cb9-437c5fd0507c taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.253908] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aa69cbad-50e9-4783-9cb9-437c5fd0507c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.253980] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aa69cbad-50e9-4783-9cb9-437c5fd0507c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.258348] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aa69cbad-50e9-4783-9cb9-437c5fd0507c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.258348] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aa69cbad-50e9-4783-9cb9-437c5fd0507c',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.758599] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port aa69cbad-50e9-4783-9cb9-437c5fd0507c [ 774.758863] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.758994] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.759092] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.759282] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.759372] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.759471] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:aa69cbad-50e9-4783-9cb9-437c5fd0507c already deleted. [ 774.759590] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aa69cbad-50e9-4783-9cb9-437c5fd0507c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.141207] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1eb9f24d-331e-450b-9da0-82652ecba032 in Status: SUCCESS [ 776.141207] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1eb9f24d-331e-450b-9da0-82652ecba032" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.141571] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1eb9f24d-331e-450b-9da0-82652ecba032" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.141571] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1eb9f24d-331e-450b-9da0-82652ecba032" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.141754] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.141877] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.141944] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.142109] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.142200] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.142444] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1eb9f24d-331e-450b-9da0-82652ecba032" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.142444] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1eb9f24d-331e-450b-9da0-82652ecba032',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.208514] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f5186e6-2d35-4ccf-a8b4-749a0a872128 in Status: SUCCESS [ 776.209381] env[69232]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9f5186e6-2d35-4ccf-a8b4-749a0a872128 deletion is rescheduled due to dependency. [ 776.209381] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.370272] env[69232]: INFO networking_nsxv3.common.synchronization [req-1893780e-4c9b-4846-ab10-7db33b120d80 req-ea0b6c32-6d2b-4def-b666-d3df2ecb453d tempest-ServersAdminTestJSON-2143393640 tempest-ServersAdminTestJSON-2143393640-project-member] Enqueued Resource ID: d2391c01-2410-4874-a5a8-6da2d957e88c with Priority: HIGHEST for action security_group_members [ 776.372028] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2391c01-2410-4874-a5a8-6da2d957e88c with Priority: HIGHEST for action security_group_members [ 776.372028] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2391c01-2410-4874-a5a8-6da2d957e88c taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.372028] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2391c01-2410-4874-a5a8-6da2d957e88c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.372028] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2391c01-2410-4874-a5a8-6da2d957e88c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.372028] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2391c01-2410-4874-a5a8-6da2d957e88c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.372028] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.372028] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.372028] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.372028] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.372028] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.372028] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d2391c01-2410-4874-a5a8-6da2d957e88c',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.574388] env[69232]: INFO networking_nsxv3.common.synchronization [None req-4a7b4ae8-5a99-4e5c-a090-b416712d87d9 None None] Enqueued Resource ID: 49a6e622-e766-4310-9509-8db63ba0c8dc with Priority: HIGHEST for action port [ 776.575331] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49a6e622-e766-4310-9509-8db63ba0c8dc with Priority: HIGHEST for action port [ 776.576260] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-49a6e622-e766-4310-9509-8db63ba0c8dc taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.576260] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-49a6e622-e766-4310-9509-8db63ba0c8dc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.576260] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-49a6e622-e766-4310-9509-8db63ba0c8dc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.576400] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-49a6e622-e766-4310-9509-8db63ba0c8dc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.576400] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('49a6e622-e766-4310-9509-8db63ba0c8dc',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.645586] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1eb9f24d-331e-450b-9da0-82652ecba032',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.740245] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock network-186 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.740366] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "network-186" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.740419] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "network-186" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.740749] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "network-186" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.742987] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.743325] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.743708] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.744114] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.744331] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.744557] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 776.744687] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] NeedRegenerationException {{(pid=69232) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 776.744801] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] no value, waiting for create lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 776.744911] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] value creation lock acquired {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 776.745087] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 776.745146] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Calling creation function for not-yet-present value {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 776.745287] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 776.768681] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 776.768865] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=69232) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 776.769016] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Released creation lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 776.769239] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "network-186" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.769568] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock port-9bf5dc16-caac-4548-962c-eb7825f7805a taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.769741] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "port-9bf5dc16-caac-4548-962c-eb7825f7805a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.769862] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "port-9bf5dc16-caac-4548-962c-eb7825f7805a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.770309] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "port-9bf5dc16-caac-4548-962c-eb7825f7805a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.770454] env[69232]: DEBUG networking_nsxv3.api.rpc [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9bf5dc16-caac-4548-962c-eb7825f7805a',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.875859] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.876022] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.876088] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.876299] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.876389] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.876590] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.876795] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.876795] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.876954] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.877040] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.877102] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d2391c01-2410-4874-a5a8-6da2d957e88c already deleted. [ 776.877131] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2391c01-2410-4874-a5a8-6da2d957e88c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.081217] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 49a6e622-e766-4310-9509-8db63ba0c8dc [ 777.081217] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.081217] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.081217] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.081217] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.081217] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.081217] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:49a6e622-e766-4310-9509-8db63ba0c8dc already deleted. [ 777.081217] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-49a6e622-e766-4310-9509-8db63ba0c8dc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.149504] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1eb9f24d-331e-450b-9da0-82652ecba032: rpc.has_security_group_logging(os_id): False [ 777.167349] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.167568] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.167568] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.167763] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.167852] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.168124] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.168248] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.168313] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.168480] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.168573] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.168666] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1eb9f24d-331e-450b-9da0-82652ecba032 is going to be created. [ 777.246670] env[69232]: INFO networking_nsxv3.common.synchronization [None req-5662ecad-fb7d-4c79-be50-3f2dfd856f0e tempest-AttachInterfacesTestJSON-1442903876 tempest-AttachInterfacesTestJSON-1442903876-project-member] Enqueued Resource ID: 4843729c-bd07-48e1-9798-7dc90829718d with Priority: HIGHEST for action security_group_rules [ 777.247924] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4843729c-bd07-48e1-9798-7dc90829718d with Priority: HIGHEST for action security_group_rules [ 777.248072] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4843729c-bd07-48e1-9798-7dc90829718d taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.248332] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4843729c-bd07-48e1-9798-7dc90829718d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.249627] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4843729c-bd07-48e1-9798-7dc90829718d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.249627] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4843729c-bd07-48e1-9798-7dc90829718d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.249627] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4843729c-bd07-48e1-9798-7dc90829718d',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.269415] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.269415] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.269415] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.269415] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.269415] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.276204] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.276414] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.276560] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.279141] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.279356] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.279519] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Segment Port 9bf5dc16-caac-4548-962c-eb7825f7805a not found, creating... [ 777.279862] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.280084] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.280317] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.280422] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.280561] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.280944] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.281084] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.281385] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.281581] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.281725] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.281866] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Resource: SegmentPort with ID: 9bf5dc16-caac-4548-962c-eb7825f7805a is going to be created. [ 777.285041] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1eb9f24d-331e-450b-9da0-82652ecba032 in Status: IN_PROGRESS for 2s [ 777.311375] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.311375] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.311375] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.311375] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.311375] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.311375] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "port-9bf5dc16-caac-4548-962c-eb7825f7805a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.397545] env[69232]: INFO networking_nsxv3.common.synchronization [None req-0e0e6c02-eb23-4992-9f18-5686899eeed1 tempest-AttachInterfacesTestJSON-1442903876 tempest-AttachInterfacesTestJSON-1442903876-project-member] Enqueued Resource ID: 4843729c-bd07-48e1-9798-7dc90829718d with Priority: HIGHEST for action security_group_rules [ 777.397545] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4843729c-bd07-48e1-9798-7dc90829718d with Priority: HIGHEST for action security_group_rules [ 777.397545] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4843729c-bd07-48e1-9798-7dc90829718d taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.397545] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4843729c-bd07-48e1-9798-7dc90829718d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.770860] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.771095] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.771189] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.771396] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.771483] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.771577] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4843729c-bd07-48e1-9798-7dc90829718d already deleted. [ 777.771668] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4843729c-bd07-48e1-9798-7dc90829718d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.772313] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4843729c-bd07-48e1-9798-7dc90829718d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.772313] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4843729c-bd07-48e1-9798-7dc90829718d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.772313] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4843729c-bd07-48e1-9798-7dc90829718d',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.293726] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.294082] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.294136] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.294692] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.297411] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.297411] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4843729c-bd07-48e1-9798-7dc90829718d already deleted. [ 778.297411] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4843729c-bd07-48e1-9798-7dc90829718d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.574189] env[69232]: INFO networking_nsxv3.common.synchronization [req-1893780e-4c9b-4846-ab10-7db33b120d80 req-6b30787c-25bd-4385-9fdd-18c0e636da6e service nova] Enqueued Resource ID: d2391c01-2410-4874-a5a8-6da2d957e88c with Priority: HIGHEST for action security_group_rules [ 778.574189] env[69232]: INFO networking_nsxv3.common.synchronization [req-1893780e-4c9b-4846-ab10-7db33b120d80 req-6b30787c-25bd-4385-9fdd-18c0e636da6e service nova] Enqueued Resource ID: d2391c01-2410-4874-a5a8-6da2d957e88c with Priority: HIGHEST for action security_group_members [ 778.574189] env[69232]: INFO networking_nsxv3.common.synchronization [req-1893780e-4c9b-4846-ab10-7db33b120d80 req-6b30787c-25bd-4385-9fdd-18c0e636da6e service nova] Enqueued Resource ID: 9bf5dc16-caac-4548-962c-eb7825f7805a with Priority: HIGHEST for action port [ 778.574735] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2391c01-2410-4874-a5a8-6da2d957e88c with Priority: HIGHEST for action security_group_rules [ 778.576402] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2391c01-2410-4874-a5a8-6da2d957e88c with Priority: HIGHEST for action security_group_members [ 778.576402] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9bf5dc16-caac-4548-962c-eb7825f7805a with Priority: HIGHEST for action port [ 778.576402] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d2391c01-2410-4874-a5a8-6da2d957e88c taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.576402] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d2391c01-2410-4874-a5a8-6da2d957e88c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.576402] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d2391c01-2410-4874-a5a8-6da2d957e88c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.576618] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d2391c01-2410-4874-a5a8-6da2d957e88c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.576650] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d2391c01-2410-4874-a5a8-6da2d957e88c',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.577594] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2391c01-2410-4874-a5a8-6da2d957e88c taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.577915] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2391c01-2410-4874-a5a8-6da2d957e88c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.578096] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2391c01-2410-4874-a5a8-6da2d957e88c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.578298] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2391c01-2410-4874-a5a8-6da2d957e88c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.578581] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.579048] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.579086] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.579245] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.579337] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.579435] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d2391c01-2410-4874-a5a8-6da2d957e88c',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.580365] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-9bf5dc16-caac-4548-962c-eb7825f7805a taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.580475] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9bf5dc16-caac-4548-962c-eb7825f7805a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.580475] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9bf5dc16-caac-4548-962c-eb7825f7805a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.580624] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9bf5dc16-caac-4548-962c-eb7825f7805a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.580703] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9bf5dc16-caac-4548-962c-eb7825f7805a',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.085096] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d2391c01-2410-4874-a5a8-6da2d957e88c',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.086203] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2391c01-2410-4874-a5a8-6da2d957e88c taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.086322] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2391c01-2410-4874-a5a8-6da2d957e88c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.086455] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9bf5dc16-caac-4548-962c-eb7825f7805a with status ACTIVE [ 779.086604] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.087342] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.087342] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.087342] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.087342] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.087342] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.087612] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.087612] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.087612] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.087719] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.087853] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.087948] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.088021] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.090087] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.090087] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.090087] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9bf5dc16-caac-4548-962c-eb7825f7805a is going to be updated. [ 779.118014] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.118184] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.118254] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.118480] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.118694] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.118783] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9bf5dc16-caac-4548-962c-eb7825f7805a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.300616] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1eb9f24d-331e-450b-9da0-82652ecba032 in Status: SUCCESS [ 779.300967] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1eb9f24d-331e-450b-9da0-82652ecba032" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.557381] env[69232]: INFO networking_nsxv3.common.synchronization [None req-53a27cc8-4edd-43f8-a5cf-444ed3ca65e3 None None] Enqueued Resource ID: 34af5a71-cea9-4315-a072-217b03f0b354 with Priority: HIGHEST for action port [ 779.557381] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34af5a71-cea9-4315-a072-217b03f0b354 with Priority: HIGHEST for action port [ 779.557381] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-34af5a71-cea9-4315-a072-217b03f0b354 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.557381] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-34af5a71-cea9-4315-a072-217b03f0b354" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.557381] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-34af5a71-cea9-4315-a072-217b03f0b354" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.557381] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-34af5a71-cea9-4315-a072-217b03f0b354" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.558295] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('34af5a71-cea9-4315-a072-217b03f0b354',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.582710] env[69232]: INFO networking_nsxv3.common.synchronization [req-f3f5a238-57ca-4d83-9a89-1f5ab94e2aac req-347bbae3-d9bd-4ed3-a3ee-3a755997fc63 tempest-ListImageFiltersTestJSON-1520270285 tempest-ListImageFiltersTestJSON-1520270285-project-member] Enqueued Resource ID: dcd9f79f-c997-4a2d-83a2-472c849b1794 with Priority: HIGHEST for action security_group_members [ 779.582710] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dcd9f79f-c997-4a2d-83a2-472c849b1794 with Priority: HIGHEST for action security_group_members [ 779.582710] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-dcd9f79f-c997-4a2d-83a2-472c849b1794 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.582710] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dcd9f79f-c997-4a2d-83a2-472c849b1794" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.582710] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dcd9f79f-c997-4a2d-83a2-472c849b1794" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.582710] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dcd9f79f-c997-4a2d-83a2-472c849b1794" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.582710] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.582710] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.582710] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.582710] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.582710] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.582710] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dcd9f79f-c997-4a2d-83a2-472c849b1794',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.591799] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d2391c01-2410-4874-a5a8-6da2d957e88c',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.976848] env[69232]: INFO networking_nsxv3.common.synchronization [req-8c56d15d-0349-4846-895d-008664996f21 req-fd252ea4-86b8-464c-a719-93aa90b90f9d tempest-SecurityGroupsTestJSON-1763653160 tempest-SecurityGroupsTestJSON-1763653160-project-member] Enqueued Resource ID: 0a7a78fa-fad0-458c-afc2-e1d98c9176ab with Priority: HIGHEST for action security_group_members [ 779.977451] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a7a78fa-fad0-458c-afc2-e1d98c9176ab with Priority: HIGHEST for action security_group_members [ 779.977781] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.978310] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.978396] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.978659] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.978841] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.978978] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.979072] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.979245] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.979351] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.979460] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0a7a78fa-fad0-458c-afc2-e1d98c9176ab',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.062127] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 34af5a71-cea9-4315-a072-217b03f0b354 [ 780.062127] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.062127] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.062127] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.062127] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.062127] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.062127] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:34af5a71-cea9-4315-a072-217b03f0b354 already deleted. [ 780.062127] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-34af5a71-cea9-4315-a072-217b03f0b354" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.085909] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.086073] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.086140] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.086378] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.086472] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.086660] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.086752] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.086809] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.086955] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.087037] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.087120] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dcd9f79f-c997-4a2d-83a2-472c849b1794 is going to be updated. [ 780.095287] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.095434] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.095505] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.095724] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.095978] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.095978] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d2391c01-2410-4874-a5a8-6da2d957e88c is going to be created. [ 780.120307] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.120307] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.120307] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.120307] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.120307] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.123350] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.123486] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.123568] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.124059] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.124059] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.135328] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dcd9f79f-c997-4a2d-83a2-472c849b1794 in Status: IN_PROGRESS for 2s [ 780.136335] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d2391c01-2410-4874-a5a8-6da2d957e88c in Status: UNINITIALIZED for 2s [ 780.486225] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.486225] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.486225] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.486225] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.486225] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.486225] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.486225] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.486225] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.486225] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.486225] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.486225] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a7a78fa-fad0-458c-afc2-e1d98c9176ab already deleted. [ 780.486225] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.487929] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock network-505 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.488388] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "network-505" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.488388] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "network-505" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.488707] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "network-505" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.489040] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.489251] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.489399] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.489732] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.489978] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.490606] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 780.491993] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] NeedRegenerationException {{(pid=69232) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 780.492221] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] no value, waiting for create lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 780.492425] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] value creation lock acquired {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 780.492609] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 780.492778] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Calling creation function for not-yet-present value {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 780.493040] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 780.513789] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 780.515223] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69232) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 780.515223] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Released creation lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 780.515223] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "network-505" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.515223] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock port-89e8cb5f-6e55-49b9-953c-354eb5e5748f taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.515223] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "port-89e8cb5f-6e55-49b9-953c-354eb5e5748f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.515223] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "port-89e8cb5f-6e55-49b9-953c-354eb5e5748f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.515775] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "port-89e8cb5f-6e55-49b9-953c-354eb5e5748f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.515903] env[69232]: DEBUG networking_nsxv3.api.rpc [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('89e8cb5f-6e55-49b9-953c-354eb5e5748f',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.018847] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.019084] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.019157] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.019404] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.019565] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.019731] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Segment Port 89e8cb5f-6e55-49b9-953c-354eb5e5748f not found, creating... [ 781.020009] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.020468] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.020468] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.020643] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.020693] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.020935] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.021118] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.021678] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.022459] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.022699] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.022872] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Resource: SegmentPort with ID: 89e8cb5f-6e55-49b9-953c-354eb5e5748f is going to be created. [ 781.043340] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.043620] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.043661] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.043948] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.044228] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.044467] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "port-89e8cb5f-6e55-49b9-953c-354eb5e5748f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.968438] env[69232]: INFO networking_nsxv3.common.synchronization [None req-a74ebd77-87f7-4622-b36a-fc56d36f46fa None None] Enqueued Resource ID: fc644da5-7eca-4058-8ad3-af43710476fc with Priority: HIGHEST for action port [ 781.968668] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc644da5-7eca-4058-8ad3-af43710476fc with Priority: HIGHEST for action port [ 781.969267] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-fc644da5-7eca-4058-8ad3-af43710476fc taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.969394] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fc644da5-7eca-4058-8ad3-af43710476fc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.969465] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fc644da5-7eca-4058-8ad3-af43710476fc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.969709] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fc644da5-7eca-4058-8ad3-af43710476fc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.969795] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fc644da5-7eca-4058-8ad3-af43710476fc',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.118683] env[69232]: INFO networking_nsxv3.common.synchronization [req-8c56d15d-0349-4846-895d-008664996f21 req-06c3e1be-b881-4d53-91fd-c2c2c111b72e service nova] Enqueued Resource ID: 0a7a78fa-fad0-458c-afc2-e1d98c9176ab with Priority: HIGHEST for action security_group_rules [ 782.118873] env[69232]: INFO networking_nsxv3.common.synchronization [req-8c56d15d-0349-4846-895d-008664996f21 req-06c3e1be-b881-4d53-91fd-c2c2c111b72e service nova] Enqueued Resource ID: 0a7a78fa-fad0-458c-afc2-e1d98c9176ab with Priority: HIGHEST for action security_group_members [ 782.119073] env[69232]: INFO networking_nsxv3.common.synchronization [req-8c56d15d-0349-4846-895d-008664996f21 req-06c3e1be-b881-4d53-91fd-c2c2c111b72e service nova] Enqueued Resource ID: 89e8cb5f-6e55-49b9-953c-354eb5e5748f with Priority: HIGHEST for action port [ 782.119547] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a7a78fa-fad0-458c-afc2-e1d98c9176ab with Priority: HIGHEST for action security_group_rules [ 782.119657] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a7a78fa-fad0-458c-afc2-e1d98c9176ab with Priority: HIGHEST for action security_group_members [ 782.119753] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 89e8cb5f-6e55-49b9-953c-354eb5e5748f with Priority: HIGHEST for action port [ 782.122076] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0a7a78fa-fad0-458c-afc2-e1d98c9176ab taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.122854] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.122854] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.122854] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.122854] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0a7a78fa-fad0-458c-afc2-e1d98c9176ab',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.124313] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.124435] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.124507] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.124687] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.124947] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.125046] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.125144] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.125245] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.125330] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.125428] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0a7a78fa-fad0-458c-afc2-e1d98c9176ab',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.126638] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-89e8cb5f-6e55-49b9-953c-354eb5e5748f taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.126747] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-89e8cb5f-6e55-49b9-953c-354eb5e5748f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.126815] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-89e8cb5f-6e55-49b9-953c-354eb5e5748f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.126966] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-89e8cb5f-6e55-49b9-953c-354eb5e5748f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.127052] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('89e8cb5f-6e55-49b9-953c-354eb5e5748f',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.147267] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d2391c01-2410-4874-a5a8-6da2d957e88c in Status: SUCCESS [ 782.147491] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2391c01-2410-4874-a5a8-6da2d957e88c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.147681] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2391c01-2410-4874-a5a8-6da2d957e88c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.147849] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2391c01-2410-4874-a5a8-6da2d957e88c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.148039] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.148163] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.148231] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.148389] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.148470] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.148554] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2391c01-2410-4874-a5a8-6da2d957e88c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.148645] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d2391c01-2410-4874-a5a8-6da2d957e88c',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.151434] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dcd9f79f-c997-4a2d-83a2-472c849b1794 in Status: SUCCESS [ 782.151624] env[69232]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dcd9f79f-c997-4a2d-83a2-472c849b1794 deletion is rescheduled due to dependency. [ 782.151728] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dcd9f79f-c997-4a2d-83a2-472c849b1794" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.475499] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fc644da5-7eca-4058-8ad3-af43710476fc [ 782.475499] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.475499] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.475753] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.475805] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.475982] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.476116] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fc644da5-7eca-4058-8ad3-af43710476fc already deleted. [ 782.476212] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fc644da5-7eca-4058-8ad3-af43710476fc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.625373] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.625373] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.628077] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0a7a78fa-fad0-458c-afc2-e1d98c9176ab',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.629257] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 89e8cb5f-6e55-49b9-953c-354eb5e5748f with status ACTIVE [ 782.629487] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.629803] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.629803] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.630045] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.630851] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.630851] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.630851] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.630851] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.630851] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.630851] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.631124] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.631124] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.631247] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.631313] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.631416] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.631453] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 89e8cb5f-6e55-49b9-953c-354eb5e5748f is going to be updated. [ 782.651036] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2391c01-2410-4874-a5a8-6da2d957e88c taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.651675] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2391c01-2410-4874-a5a8-6da2d957e88c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.651780] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2391c01-2410-4874-a5a8-6da2d957e88c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.652058] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2391c01-2410-4874-a5a8-6da2d957e88c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.652270] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.652394] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.652498] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.652661] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.652753] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.652885] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2391c01-2410-4874-a5a8-6da2d957e88c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.653856] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2391c01-2410-4874-a5a8-6da2d957e88c taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.653856] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2391c01-2410-4874-a5a8-6da2d957e88c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.653856] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2391c01-2410-4874-a5a8-6da2d957e88c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.653856] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2391c01-2410-4874-a5a8-6da2d957e88c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.653856] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.653856] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.653856] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.653856] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.653856] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.653856] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2391c01-2410-4874-a5a8-6da2d957e88c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.654319] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d2391c01-2410-4874-a5a8-6da2d957e88c',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.661543] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.661543] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.661543] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.661543] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.661543] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.661543] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-89e8cb5f-6e55-49b9-953c-354eb5e5748f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.130231] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0a7a78fa-fad0-458c-afc2-e1d98c9176ab',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.157608] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d2391c01-2410-4874-a5a8-6da2d957e88c: rpc.has_security_group_logging(os_id): False [ 783.187441] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.187832] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.187832] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.187931] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.187977] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.188727] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.188727] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.188727] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.188727] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.188727] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.188727] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.189108] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.189108] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.189108] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.189108] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.189238] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.189965] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.189965] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.189965] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.189965] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.189965] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d2391c01-2410-4874-a5a8-6da2d957e88c is going to be created. [ 783.260436] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.260576] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.260632] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.260881] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.261073] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.274446] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d2391c01-2410-4874-a5a8-6da2d957e88c in Status: IN_PROGRESS for 2s [ 783.637201] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.637354] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.637413] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.637626] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.637713] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.637808] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a7a78fa-fad0-458c-afc2-e1d98c9176ab is going to be created. [ 783.663036] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.663239] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.663343] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.663744] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.663979] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.678948] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a7a78fa-fad0-458c-afc2-e1d98c9176ab in Status: UNINITIALIZED for 2s [ 784.623284] env[69232]: INFO networking_nsxv3.common.synchronization [req-6b5feff7-ec15-455c-8e4c-d792a3d4d109 req-dde2ce3f-8597-4934-bc1d-bebefc5a00b3 tempest-ServersAdminTestJSON-2143393640 tempest-ServersAdminTestJSON-2143393640-project-member] Enqueued Resource ID: d2391c01-2410-4874-a5a8-6da2d957e88c with Priority: HIGHEST for action security_group_members [ 784.624217] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2391c01-2410-4874-a5a8-6da2d957e88c with Priority: HIGHEST for action security_group_members [ 784.624560] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2391c01-2410-4874-a5a8-6da2d957e88c taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.624697] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2391c01-2410-4874-a5a8-6da2d957e88c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.624765] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2391c01-2410-4874-a5a8-6da2d957e88c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.624969] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2391c01-2410-4874-a5a8-6da2d957e88c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.625143] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.625241] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.625306] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.625455] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.625541] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.625636] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d2391c01-2410-4874-a5a8-6da2d957e88c',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.051993] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock network-186 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.051993] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "network-186" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.051993] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "network-186" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.051993] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "network-186" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.051993] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.051993] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.052392] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.052428] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.052620] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.052909] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 785.053073] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] NeedRegenerationException {{(pid=69232) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 785.053890] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] no value, waiting for create lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 785.053890] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] value creation lock acquired {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 785.053890] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 785.053890] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Calling creation function for not-yet-present value {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 785.053890] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 785.079167] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 785.079393] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=69232) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 785.079580] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Released creation lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 785.079803] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "network-186" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.080246] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock port-11088542-c11d-4ee7-8538-1a7ef8360888 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.080476] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "port-11088542-c11d-4ee7-8538-1a7ef8360888" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.080638] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "port-11088542-c11d-4ee7-8538-1a7ef8360888" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.081039] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "port-11088542-c11d-4ee7-8538-1a7ef8360888" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.081229] env[69232]: DEBUG networking_nsxv3.api.rpc [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('11088542-c11d-4ee7-8538-1a7ef8360888',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.127762] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d2391c01-2410-4874-a5a8-6da2d957e88c',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.289467] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d2391c01-2410-4874-a5a8-6da2d957e88c in Status: SUCCESS [ 785.289718] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d2391c01-2410-4874-a5a8-6da2d957e88c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.584546] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.584753] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.584877] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.585838] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.585838] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.585838] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Segment Port 11088542-c11d-4ee7-8538-1a7ef8360888 not found, creating... [ 785.585838] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.586120] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.586120] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.586369] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.586494] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.586779] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.586995] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.587138] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.587377] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.587558] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.587709] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Resource: SegmentPort with ID: 11088542-c11d-4ee7-8538-1a7ef8360888 is going to be created. [ 785.608259] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.608611] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.608750] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.609038] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.610020] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.610399] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "port-11088542-c11d-4ee7-8538-1a7ef8360888" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.631318] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d2391c01-2410-4874-a5a8-6da2d957e88c',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.695646] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a7a78fa-fad0-458c-afc2-e1d98c9176ab in Status: SUCCESS [ 785.695646] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.695646] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.695646] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.695646] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.695646] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.695646] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.695646] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.695646] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.697045] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.697045] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0a7a78fa-fad0-458c-afc2-e1d98c9176ab',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.133594] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.133750] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.133821] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.134043] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.134140] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.134238] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d2391c01-2410-4874-a5a8-6da2d957e88c is going to be updated. [ 786.171602] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.171803] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.171803] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.172047] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.172182] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.183041] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d2391c01-2410-4874-a5a8-6da2d957e88c in Status: IN_PROGRESS for 2s [ 786.200016] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.200016] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.200016] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.200016] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.200016] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.200016] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.200016] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.200016] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.200016] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.200401] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.200401] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.200401] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.200401] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.200521] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.200750] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.200750] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.200881] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.200985] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.201050] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.201207] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.201207] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0a7a78fa-fad0-458c-afc2-e1d98c9176ab',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.320028] env[69232]: INFO networking_nsxv3.common.synchronization [req-6b5feff7-ec15-455c-8e4c-d792a3d4d109 req-eb06daba-f7b7-4622-b91a-91f474e9e98b service nova] Enqueued Resource ID: d2391c01-2410-4874-a5a8-6da2d957e88c with Priority: HIGHEST for action security_group_rules [ 786.320028] env[69232]: INFO networking_nsxv3.common.synchronization [req-6b5feff7-ec15-455c-8e4c-d792a3d4d109 req-eb06daba-f7b7-4622-b91a-91f474e9e98b service nova] Enqueued Resource ID: d2391c01-2410-4874-a5a8-6da2d957e88c with Priority: HIGHEST for action security_group_members [ 786.320028] env[69232]: INFO networking_nsxv3.common.synchronization [req-6b5feff7-ec15-455c-8e4c-d792a3d4d109 req-eb06daba-f7b7-4622-b91a-91f474e9e98b service nova] Enqueued Resource ID: 11088542-c11d-4ee7-8538-1a7ef8360888 with Priority: HIGHEST for action port [ 786.320028] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2391c01-2410-4874-a5a8-6da2d957e88c with Priority: HIGHEST for action security_group_rules [ 786.320028] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2391c01-2410-4874-a5a8-6da2d957e88c with Priority: HIGHEST for action security_group_members [ 786.320028] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11088542-c11d-4ee7-8538-1a7ef8360888 with Priority: HIGHEST for action port [ 786.320028] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d2391c01-2410-4874-a5a8-6da2d957e88c taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.320028] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d2391c01-2410-4874-a5a8-6da2d957e88c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.320830] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d2391c01-2410-4874-a5a8-6da2d957e88c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.321091] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d2391c01-2410-4874-a5a8-6da2d957e88c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.321181] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d2391c01-2410-4874-a5a8-6da2d957e88c',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.322871] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2391c01-2410-4874-a5a8-6da2d957e88c taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.322980] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2391c01-2410-4874-a5a8-6da2d957e88c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.323188] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-11088542-c11d-4ee7-8538-1a7ef8360888 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.323293] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-11088542-c11d-4ee7-8538-1a7ef8360888" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.323352] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-11088542-c11d-4ee7-8538-1a7ef8360888" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.323905] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-11088542-c11d-4ee7-8538-1a7ef8360888" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.323905] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('11088542-c11d-4ee7-8538-1a7ef8360888',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.706624] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0a7a78fa-fad0-458c-afc2-e1d98c9176ab: rpc.has_security_group_logging(os_id): False [ 786.727597] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.727753] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.727827] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.728062] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.728171] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.728636] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.728636] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.728636] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.728831] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.728831] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.729245] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.729245] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.729245] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.729411] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.729411] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.729559] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.729648] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.729728] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.729837] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.729907] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.729987] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0a7a78fa-fad0-458c-afc2-e1d98c9176ab is going to be created. [ 786.821614] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.821797] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.822029] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.822215] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.822357] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.824390] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2391c01-2410-4874-a5a8-6da2d957e88c taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.824552] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2391c01-2410-4874-a5a8-6da2d957e88c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.825331] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 11088542-c11d-4ee7-8538-1a7ef8360888 with status ACTIVE [ 786.825560] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.825720] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.825816] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.826089] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.826289] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.827675] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.827675] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.827675] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.827675] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.827675] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.828757] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.828757] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.828757] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.828757] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.828757] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.828949] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 11088542-c11d-4ee7-8538-1a7ef8360888 is going to be updated. [ 786.844885] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0a7a78fa-fad0-458c-afc2-e1d98c9176ab in Status: IN_PROGRESS for 2s [ 786.864373] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.867094] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.867094] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.867094] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.867094] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.867094] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-11088542-c11d-4ee7-8538-1a7ef8360888" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.624992] env[69232]: INFO networking_nsxv3.common.synchronization [req-66ad080c-57c4-4410-adf7-a06a664d844a req-114debba-6748-4d64-9b2c-a5a08353af1a tempest-ServersAdminNegativeTestJSON-879816592 tempest-ServersAdminNegativeTestJSON-879816592-project-member] Enqueued Resource ID: 256e29a3-9ff8-45a1-805b-591f83c2a8b4 with Priority: HIGHEST for action security_group_members [ 787.624992] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 256e29a3-9ff8-45a1-805b-591f83c2a8b4 with Priority: HIGHEST for action security_group_members [ 787.624992] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-256e29a3-9ff8-45a1-805b-591f83c2a8b4 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.624992] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-256e29a3-9ff8-45a1-805b-591f83c2a8b4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.624992] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-256e29a3-9ff8-45a1-805b-591f83c2a8b4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.624992] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-256e29a3-9ff8-45a1-805b-591f83c2a8b4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.628380] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.628529] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.628571] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.628767] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.628861] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.628962] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('256e29a3-9ff8-45a1-805b-591f83c2a8b4',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.131793] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('256e29a3-9ff8-45a1-805b-591f83c2a8b4',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.193647] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d2391c01-2410-4874-a5a8-6da2d957e88c in Status: SUCCESS [ 788.193647] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2391c01-2410-4874-a5a8-6da2d957e88c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.195450] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2391c01-2410-4874-a5a8-6da2d957e88c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.195776] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2391c01-2410-4874-a5a8-6da2d957e88c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.199312] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.199454] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.199526] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.199728] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.199819] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.200009] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d2391c01-2410-4874-a5a8-6da2d957e88c',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.213635] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock network-225 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.214560] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "network-225" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.214699] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "network-225" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.214982] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "network-225" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.215283] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.215462] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.215590] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.215815] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.215973] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.216186] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 788.216373] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] NeedRegenerationException {{(pid=69232) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 788.216409] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] no value, waiting for create lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 788.216499] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] value creation lock acquired {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 788.216607] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 788.216766] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Calling creation function for not-yet-present value {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 788.216915] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 788.235749] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 788.235943] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69232) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 788.236304] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Released creation lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 788.236304] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "network-225" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.236617] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock port-a74d91fd-1bbf-431a-80e1-e51764ca49e8 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.236729] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "port-a74d91fd-1bbf-431a-80e1-e51764ca49e8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.236853] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "port-a74d91fd-1bbf-431a-80e1-e51764ca49e8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.237242] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "port-a74d91fd-1bbf-431a-80e1-e51764ca49e8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.237440] env[69232]: DEBUG networking_nsxv3.api.rpc [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a74d91fd-1bbf-431a-80e1-e51764ca49e8',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.634918] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('256e29a3-9ff8-45a1-805b-591f83c2a8b4',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.702413] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d2391c01-2410-4874-a5a8-6da2d957e88c',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.744331] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.744697] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.744905] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.745347] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.745608] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.745854] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Segment Port a74d91fd-1bbf-431a-80e1-e51764ca49e8 not found, creating... [ 788.746317] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.746610] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.746802] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.747172] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.747435] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.747883] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.748133] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.748322] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.748633] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.748876] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.748988] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Resource: SegmentPort with ID: a74d91fd-1bbf-431a-80e1-e51764ca49e8 is going to be created. [ 788.773297] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.773519] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.773714] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.774353] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.774353] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.774509] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "port-a74d91fd-1bbf-431a-80e1-e51764ca49e8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.857730] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0a7a78fa-fad0-458c-afc2-e1d98c9176ab in Status: SUCCESS [ 788.857730] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.136935] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.137365] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.137365] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.137454] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.137512] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.137572] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 256e29a3-9ff8-45a1-805b-591f83c2a8b4 is going to be updated. [ 789.174219] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.174425] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.174425] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.174783] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.174936] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.191543] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 256e29a3-9ff8-45a1-805b-591f83c2a8b4 in Status: IN_PROGRESS for 2s [ 789.207032] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d2391c01-2410-4874-a5a8-6da2d957e88c',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.580976] env[69232]: INFO networking_nsxv3.common.synchronization [req-66ad080c-57c4-4410-adf7-a06a664d844a req-e3fcaccb-bf96-48c1-b65a-bd6177433115 service nova] Enqueued Resource ID: 256e29a3-9ff8-45a1-805b-591f83c2a8b4 with Priority: HIGHEST for action security_group_rules [ 789.581176] env[69232]: INFO networking_nsxv3.common.synchronization [req-66ad080c-57c4-4410-adf7-a06a664d844a req-e3fcaccb-bf96-48c1-b65a-bd6177433115 service nova] Enqueued Resource ID: 256e29a3-9ff8-45a1-805b-591f83c2a8b4 with Priority: HIGHEST for action security_group_members [ 789.581338] env[69232]: INFO networking_nsxv3.common.synchronization [req-66ad080c-57c4-4410-adf7-a06a664d844a req-e3fcaccb-bf96-48c1-b65a-bd6177433115 service nova] Enqueued Resource ID: a74d91fd-1bbf-431a-80e1-e51764ca49e8 with Priority: HIGHEST for action port [ 789.581571] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 256e29a3-9ff8-45a1-805b-591f83c2a8b4 with Priority: HIGHEST for action security_group_rules [ 789.581730] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 256e29a3-9ff8-45a1-805b-591f83c2a8b4 with Priority: HIGHEST for action security_group_members [ 789.581890] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a74d91fd-1bbf-431a-80e1-e51764ca49e8 with Priority: HIGHEST for action port [ 789.582385] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-256e29a3-9ff8-45a1-805b-591f83c2a8b4 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.582512] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-256e29a3-9ff8-45a1-805b-591f83c2a8b4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.582608] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-256e29a3-9ff8-45a1-805b-591f83c2a8b4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.582754] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-256e29a3-9ff8-45a1-805b-591f83c2a8b4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.582858] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('256e29a3-9ff8-45a1-805b-591f83c2a8b4',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.589845] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-256e29a3-9ff8-45a1-805b-591f83c2a8b4 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.589845] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-256e29a3-9ff8-45a1-805b-591f83c2a8b4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.589845] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-a74d91fd-1bbf-431a-80e1-e51764ca49e8 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.589845] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a74d91fd-1bbf-431a-80e1-e51764ca49e8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.589845] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a74d91fd-1bbf-431a-80e1-e51764ca49e8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.589845] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a74d91fd-1bbf-431a-80e1-e51764ca49e8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.589845] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a74d91fd-1bbf-431a-80e1-e51764ca49e8',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.709587] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.709808] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.709879] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.710071] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.710168] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.710355] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d2391c01-2410-4874-a5a8-6da2d957e88c is going to be updated. [ 789.740933] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.741092] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.741576] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.741576] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.741700] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.752059] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d2391c01-2410-4874-a5a8-6da2d957e88c in Status: IN_PROGRESS for 2s [ 790.090284] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-256e29a3-9ff8-45a1-805b-591f83c2a8b4 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.090420] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-256e29a3-9ff8-45a1-805b-591f83c2a8b4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.090910] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a74d91fd-1bbf-431a-80e1-e51764ca49e8 with status ACTIVE [ 790.091139] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.095031] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.095031] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.095031] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.095031] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.095031] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.095031] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.095031] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.095407] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.095407] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.095480] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.095657] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.095657] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.095780] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.095853] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.095936] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a74d91fd-1bbf-431a-80e1-e51764ca49e8 is going to be updated. [ 790.124066] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.124204] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.124293] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.124542] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.124662] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.124830] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a74d91fd-1bbf-431a-80e1-e51764ca49e8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.250220] env[69232]: INFO networking_nsxv3.common.synchronization [req-3cf0372d-d716-4226-9f49-43daeac2468f req-e62832fa-4012-4127-a344-53138c10ff61 tempest-ServerRescueNegativeTestJSON-737130981 tempest-ServerRescueNegativeTestJSON-737130981-project-member] Enqueued Resource ID: f29e46f4-baa2-4512-b89f-bb8fa2c53157 with Priority: HIGHEST for action security_group_members [ 790.250880] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f29e46f4-baa2-4512-b89f-bb8fa2c53157 with Priority: HIGHEST for action security_group_members [ 790.252397] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-f29e46f4-baa2-4512-b89f-bb8fa2c53157 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.253018] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f29e46f4-baa2-4512-b89f-bb8fa2c53157" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.253018] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f29e46f4-baa2-4512-b89f-bb8fa2c53157" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.253207] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f29e46f4-baa2-4512-b89f-bb8fa2c53157" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.253382] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.253638] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.255658] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.255658] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.255658] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.255658] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f29e46f4-baa2-4512-b89f-bb8fa2c53157',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.637814] env[69232]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-94066da2-e1f6-4276-9635-375c603f4834 None None] NSXv3 Agent Agent loop - iteration:0 completed [ 790.637814] env[69232]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-94066da2-e1f6-4276-9635-375c603f4834 None None] NSXv3 Agent Agent loop - iteration:1 started [ 790.757371] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.757563] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.757614] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.758549] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.758674] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.758876] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.758986] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.759064] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.759221] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.759303] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.759392] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f29e46f4-baa2-4512-b89f-bb8fa2c53157 already deleted. [ 790.759471] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f29e46f4-baa2-4512-b89f-bb8fa2c53157" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.767702] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock network-887 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.767907] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "network-887" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.768067] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "network-887" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.768345] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "network-887" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.768606] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.768772] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.768873] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.769254] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.769429] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.770064] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 790.770064] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] NeedRegenerationException {{(pid=69232) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 790.770064] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] no value, waiting for create lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 790.770622] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] value creation lock acquired {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 790.771469] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 790.771469] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Calling creation function for not-yet-present value {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 790.771469] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 790.793097] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 790.793361] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69232) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 790.793413] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Released creation lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 790.793580] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "network-887" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.794619] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock port-43bbad0b-6ee1-4df5-a429-8d6f5acac187 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.794619] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "port-43bbad0b-6ee1-4df5-a429-8d6f5acac187" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.794619] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "port-43bbad0b-6ee1-4df5-a429-8d6f5acac187" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.794934] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "port-43bbad0b-6ee1-4df5-a429-8d6f5acac187" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.795632] env[69232]: DEBUG networking_nsxv3.api.rpc [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('43bbad0b-6ee1-4df5-a429-8d6f5acac187',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.209124] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 256e29a3-9ff8-45a1-805b-591f83c2a8b4 in Status: SUCCESS [ 791.209374] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-256e29a3-9ff8-45a1-805b-591f83c2a8b4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.209715] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-256e29a3-9ff8-45a1-805b-591f83c2a8b4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.209814] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-256e29a3-9ff8-45a1-805b-591f83c2a8b4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.210059] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.210265] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.210375] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.210472] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.210557] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.210691] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('256e29a3-9ff8-45a1-805b-591f83c2a8b4',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.299197] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.299197] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.299511] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.299511] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.299686] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.299853] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Segment Port 43bbad0b-6ee1-4df5-a429-8d6f5acac187 not found, creating... [ 791.300215] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.300428] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.300574] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.300847] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.301009] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.301373] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.301555] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.301739] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.301970] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.305516] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.305718] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Resource: SegmentPort with ID: 43bbad0b-6ee1-4df5-a429-8d6f5acac187 is going to be created. [ 791.335642] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.336802] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.336802] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.337421] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.337664] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.338713] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "port-43bbad0b-6ee1-4df5-a429-8d6f5acac187" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.713815] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('256e29a3-9ff8-45a1-805b-591f83c2a8b4',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.763936] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d2391c01-2410-4874-a5a8-6da2d957e88c in Status: SUCCESS [ 791.763936] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2391c01-2410-4874-a5a8-6da2d957e88c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.763936] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2391c01-2410-4874-a5a8-6da2d957e88c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.763936] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2391c01-2410-4874-a5a8-6da2d957e88c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.763936] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.763936] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.763936] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.763936] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.763936] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.763936] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2391c01-2410-4874-a5a8-6da2d957e88c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.763936] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d2391c01-2410-4874-a5a8-6da2d957e88c',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.086078] env[69232]: INFO networking_nsxv3.common.synchronization [req-3cf0372d-d716-4226-9f49-43daeac2468f req-b0b77323-6513-4868-9b04-5f7d0b118ec8 service nova] Enqueued Resource ID: f29e46f4-baa2-4512-b89f-bb8fa2c53157 with Priority: HIGHEST for action security_group_rules [ 792.086284] env[69232]: INFO networking_nsxv3.common.synchronization [req-3cf0372d-d716-4226-9f49-43daeac2468f req-b0b77323-6513-4868-9b04-5f7d0b118ec8 service nova] Enqueued Resource ID: f29e46f4-baa2-4512-b89f-bb8fa2c53157 with Priority: HIGHEST for action security_group_members [ 792.086418] env[69232]: INFO networking_nsxv3.common.synchronization [req-3cf0372d-d716-4226-9f49-43daeac2468f req-b0b77323-6513-4868-9b04-5f7d0b118ec8 service nova] Enqueued Resource ID: 43bbad0b-6ee1-4df5-a429-8d6f5acac187 with Priority: HIGHEST for action port [ 792.086961] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f29e46f4-baa2-4512-b89f-bb8fa2c53157 with Priority: HIGHEST for action security_group_rules [ 792.087111] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f29e46f4-baa2-4512-b89f-bb8fa2c53157 with Priority: HIGHEST for action security_group_members [ 792.087246] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43bbad0b-6ee1-4df5-a429-8d6f5acac187 with Priority: HIGHEST for action port [ 792.088595] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f29e46f4-baa2-4512-b89f-bb8fa2c53157 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.088925] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f29e46f4-baa2-4512-b89f-bb8fa2c53157" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.089131] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f29e46f4-baa2-4512-b89f-bb8fa2c53157" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.089487] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f29e46f4-baa2-4512-b89f-bb8fa2c53157" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.089697] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f29e46f4-baa2-4512-b89f-bb8fa2c53157',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.092377] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-f29e46f4-baa2-4512-b89f-bb8fa2c53157 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.092498] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f29e46f4-baa2-4512-b89f-bb8fa2c53157" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.092591] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f29e46f4-baa2-4512-b89f-bb8fa2c53157" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.092798] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f29e46f4-baa2-4512-b89f-bb8fa2c53157" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.092956] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.093076] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.093138] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.093293] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.093377] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.093470] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f29e46f4-baa2-4512-b89f-bb8fa2c53157',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.094288] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-43bbad0b-6ee1-4df5-a429-8d6f5acac187 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.094397] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-43bbad0b-6ee1-4df5-a429-8d6f5acac187" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.094450] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-43bbad0b-6ee1-4df5-a429-8d6f5acac187" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.094593] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-43bbad0b-6ee1-4df5-a429-8d6f5acac187" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.094711] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('43bbad0b-6ee1-4df5-a429-8d6f5acac187',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.216198] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('256e29a3-9ff8-45a1-805b-591f83c2a8b4',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.268910] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2391c01-2410-4874-a5a8-6da2d957e88c taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.269097] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2391c01-2410-4874-a5a8-6da2d957e88c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.269145] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2391c01-2410-4874-a5a8-6da2d957e88c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.269409] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2391c01-2410-4874-a5a8-6da2d957e88c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.269540] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.269643] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.269706] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.269858] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.269960] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.270042] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2391c01-2410-4874-a5a8-6da2d957e88c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.270338] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2391c01-2410-4874-a5a8-6da2d957e88c taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.270448] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2391c01-2410-4874-a5a8-6da2d957e88c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.270524] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2391c01-2410-4874-a5a8-6da2d957e88c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.270662] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2391c01-2410-4874-a5a8-6da2d957e88c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.270802] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.271113] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.271113] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.271113] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.271252] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.271252] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2391c01-2410-4874-a5a8-6da2d957e88c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.271459] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d2391c01-2410-4874-a5a8-6da2d957e88c',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.597165] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f29e46f4-baa2-4512-b89f-bb8fa2c53157',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.597764] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-f29e46f4-baa2-4512-b89f-bb8fa2c53157 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.597764] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f29e46f4-baa2-4512-b89f-bb8fa2c53157" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.597764] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 43bbad0b-6ee1-4df5-a429-8d6f5acac187 with status ACTIVE [ 792.597977] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.597977] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.597977] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.598208] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.598298] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.598475] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.598563] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.598611] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.598792] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.598891] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.600029] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.600151] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.600274] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.600460] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.600631] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.600711] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 43bbad0b-6ee1-4df5-a429-8d6f5acac187 is going to be updated. [ 792.626504] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.626959] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.627138] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.627367] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.627925] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.627925] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-43bbad0b-6ee1-4df5-a429-8d6f5acac187" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.724686] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.724686] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.724686] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.724686] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.724686] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.724686] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 256e29a3-9ff8-45a1-805b-591f83c2a8b4 is going to be updated. [ 792.774114] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.774114] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.774114] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.774114] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.774114] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.774914] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d2391c01-2410-4874-a5a8-6da2d957e88c: rpc.has_security_group_logging(os_id): False [ 792.794071] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 256e29a3-9ff8-45a1-805b-591f83c2a8b4 in Status: IN_PROGRESS for 2s [ 792.803787] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.803787] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.803787] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.803787] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.803787] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.803787] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.803787] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.803787] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.803787] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.803787] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.803787] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.804716] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.804716] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.804716] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.804716] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.804716] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.804716] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.804716] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.804716] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.804947] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.805330] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d2391c01-2410-4874-a5a8-6da2d957e88c is going to be updated. [ 792.880116] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.880557] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.880691] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.880960] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.881184] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.896674] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d2391c01-2410-4874-a5a8-6da2d957e88c in Status: IN_PROGRESS for 2s [ 792.957125] env[69232]: INFO networking_nsxv3.common.synchronization [req-a9da6ae1-14a7-4b6c-8e84-193bb0e538c1 req-a0b6b80e-3cd5-4ea7-8246-5cb7cbc2fef8 tempest-SecurityGroupsTestJSON-1763653160 tempest-SecurityGroupsTestJSON-1763653160-project-member] Enqueued Resource ID: 0a7a78fa-fad0-458c-afc2-e1d98c9176ab with Priority: HIGHEST for action security_group_members [ 792.957125] env[69232]: INFO networking_nsxv3.common.synchronization [req-a9da6ae1-14a7-4b6c-8e84-193bb0e538c1 req-a0b6b80e-3cd5-4ea7-8246-5cb7cbc2fef8 tempest-SecurityGroupsTestJSON-1763653160 tempest-SecurityGroupsTestJSON-1763653160-project-member] Enqueued Resource ID: c518d277-32a1-437b-a0b2-37d4c69436b0 with Priority: HIGHEST for action security_group_members [ 792.958698] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a7a78fa-fad0-458c-afc2-e1d98c9176ab with Priority: HIGHEST for action security_group_members [ 792.958698] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c518d277-32a1-437b-a0b2-37d4c69436b0 with Priority: HIGHEST for action security_group_members [ 792.958698] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.958698] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.958698] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.958698] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.958698] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.958698] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.958698] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.959205] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.959205] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.960569] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0a7a78fa-fad0-458c-afc2-e1d98c9176ab',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.961182] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-c518d277-32a1-437b-a0b2-37d4c69436b0 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.961364] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c518d277-32a1-437b-a0b2-37d4c69436b0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.961461] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c518d277-32a1-437b-a0b2-37d4c69436b0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.961720] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c518d277-32a1-437b-a0b2-37d4c69436b0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.961908] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.962045] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.962251] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.962447] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.962740] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.962740] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c518d277-32a1-437b-a0b2-37d4c69436b0',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.026397] env[69232]: INFO networking_nsxv3.common.synchronization [req-a9da6ae1-14a7-4b6c-8e84-193bb0e538c1 req-a0b6b80e-3cd5-4ea7-8246-5cb7cbc2fef8 tempest-SecurityGroupsTestJSON-1763653160 tempest-SecurityGroupsTestJSON-1763653160-project-member] Enqueued Resource ID: 0a7a78fa-fad0-458c-afc2-e1d98c9176ab with Priority: HIGHEST for action security_group_rules [ 793.026397] env[69232]: INFO networking_nsxv3.common.synchronization [req-a9da6ae1-14a7-4b6c-8e84-193bb0e538c1 req-a0b6b80e-3cd5-4ea7-8246-5cb7cbc2fef8 tempest-SecurityGroupsTestJSON-1763653160 tempest-SecurityGroupsTestJSON-1763653160-project-member] Enqueued Resource ID: 0a7a78fa-fad0-458c-afc2-e1d98c9176ab with Priority: HIGHEST for action security_group_members [ 793.026397] env[69232]: INFO networking_nsxv3.common.synchronization [req-a9da6ae1-14a7-4b6c-8e84-193bb0e538c1 req-a0b6b80e-3cd5-4ea7-8246-5cb7cbc2fef8 tempest-SecurityGroupsTestJSON-1763653160 tempest-SecurityGroupsTestJSON-1763653160-project-member] Enqueued Resource ID: c518d277-32a1-437b-a0b2-37d4c69436b0 with Priority: HIGHEST for action security_group_rules [ 793.026397] env[69232]: INFO networking_nsxv3.common.synchronization [req-a9da6ae1-14a7-4b6c-8e84-193bb0e538c1 req-a0b6b80e-3cd5-4ea7-8246-5cb7cbc2fef8 tempest-SecurityGroupsTestJSON-1763653160 tempest-SecurityGroupsTestJSON-1763653160-project-member] Enqueued Resource ID: c518d277-32a1-437b-a0b2-37d4c69436b0 with Priority: HIGHEST for action security_group_members [ 793.026397] env[69232]: INFO networking_nsxv3.common.synchronization [req-a9da6ae1-14a7-4b6c-8e84-193bb0e538c1 req-a0b6b80e-3cd5-4ea7-8246-5cb7cbc2fef8 tempest-SecurityGroupsTestJSON-1763653160 tempest-SecurityGroupsTestJSON-1763653160-project-member] Enqueued Resource ID: 89e8cb5f-6e55-49b9-953c-354eb5e5748f with Priority: HIGHEST for action port [ 793.026397] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a7a78fa-fad0-458c-afc2-e1d98c9176ab with Priority: HIGHEST for action security_group_rules [ 793.033035] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c518d277-32a1-437b-a0b2-37d4c69436b0 with Priority: HIGHEST for action security_group_rules [ 793.033035] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 89e8cb5f-6e55-49b9-953c-354eb5e5748f with Priority: HIGHEST for action port [ 793.033035] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a7a78fa-fad0-458c-afc2-e1d98c9176ab with Priority: HIGHEST for action security_group_members [ 793.033035] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c518d277-32a1-437b-a0b2-37d4c69436b0 with Priority: HIGHEST for action security_group_members [ 793.033035] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0a7a78fa-fad0-458c-afc2-e1d98c9176ab taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.033035] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.033035] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.033035] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.033035] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0a7a78fa-fad0-458c-afc2-e1d98c9176ab',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.038800] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c518d277-32a1-437b-a0b2-37d4c69436b0 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.038951] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c518d277-32a1-437b-a0b2-37d4c69436b0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.039033] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c518d277-32a1-437b-a0b2-37d4c69436b0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.039321] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c518d277-32a1-437b-a0b2-37d4c69436b0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.039403] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c518d277-32a1-437b-a0b2-37d4c69436b0',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.041862] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-89e8cb5f-6e55-49b9-953c-354eb5e5748f taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.041993] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-89e8cb5f-6e55-49b9-953c-354eb5e5748f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.042081] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-89e8cb5f-6e55-49b9-953c-354eb5e5748f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.042279] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-89e8cb5f-6e55-49b9-953c-354eb5e5748f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.042357] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('89e8cb5f-6e55-49b9-953c-354eb5e5748f',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.043284] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.044919] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.044919] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-c518d277-32a1-437b-a0b2-37d4c69436b0 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.044919] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c518d277-32a1-437b-a0b2-37d4c69436b0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.106590] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f29e46f4-baa2-4512-b89f-bb8fa2c53157',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.465402] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0a7a78fa-fad0-458c-afc2-e1d98c9176ab',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.468516] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c518d277-32a1-437b-a0b2-37d4c69436b0',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.545203] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.545345] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.545766] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-c518d277-32a1-437b-a0b2-37d4c69436b0 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.545766] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c518d277-32a1-437b-a0b2-37d4c69436b0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.545906] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 89e8cb5f-6e55-49b9-953c-354eb5e5748f with status ACTIVE [ 793.546018] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.546142] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.546214] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.546430] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.546525] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.546710] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.546807] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.546872] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.547052] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.547136] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.547322] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.547417] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.547479] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.547630] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.547739] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.547843] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 89e8cb5f-6e55-49b9-953c-354eb5e5748f is going to be updated. [ 793.576596] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.577277] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.578304] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.578687] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.579108] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.579385] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-89e8cb5f-6e55-49b9-953c-354eb5e5748f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.609724] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.610180] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.610180] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.610657] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.610759] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.610883] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f29e46f4-baa2-4512-b89f-bb8fa2c53157 is going to be created. [ 793.646584] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.646756] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.646830] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.647083] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.647270] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.664145] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f29e46f4-baa2-4512-b89f-bb8fa2c53157 in Status: UNINITIALIZED for 2s [ 793.823023] env[69232]: INFO networking_nsxv3.common.synchronization [req-51582c97-7803-403b-be47-6a22c921de30 req-b4191ed2-d6b1-4d5a-97e6-1de7190316e7 tempest-SecurityGroupsTestJSON-1763653160 tempest-SecurityGroupsTestJSON-1763653160-project-member] Enqueued Resource ID: b403d6f4-9cfd-407a-9a3f-9a486dae20dc with Priority: HIGHEST for action security_group_members [ 793.823939] env[69232]: INFO networking_nsxv3.common.synchronization [req-51582c97-7803-403b-be47-6a22c921de30 req-b4191ed2-d6b1-4d5a-97e6-1de7190316e7 tempest-SecurityGroupsTestJSON-1763653160 tempest-SecurityGroupsTestJSON-1763653160-project-member] Enqueued Resource ID: 0a7a78fa-fad0-458c-afc2-e1d98c9176ab with Priority: HIGHEST for action security_group_members [ 793.823939] env[69232]: INFO networking_nsxv3.common.synchronization [req-51582c97-7803-403b-be47-6a22c921de30 req-b4191ed2-d6b1-4d5a-97e6-1de7190316e7 tempest-SecurityGroupsTestJSON-1763653160 tempest-SecurityGroupsTestJSON-1763653160-project-member] Enqueued Resource ID: c518d277-32a1-437b-a0b2-37d4c69436b0 with Priority: HIGHEST for action security_group_members [ 793.825342] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b403d6f4-9cfd-407a-9a3f-9a486dae20dc with Priority: HIGHEST for action security_group_members [ 793.825342] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a7a78fa-fad0-458c-afc2-e1d98c9176ab with Priority: HIGHEST for action security_group_members [ 793.825460] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c518d277-32a1-437b-a0b2-37d4c69436b0 with Priority: HIGHEST for action security_group_members [ 793.825816] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-b403d6f4-9cfd-407a-9a3f-9a486dae20dc taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.825970] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b403d6f4-9cfd-407a-9a3f-9a486dae20dc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.826120] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b403d6f4-9cfd-407a-9a3f-9a486dae20dc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.826404] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b403d6f4-9cfd-407a-9a3f-9a486dae20dc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.826622] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.826768] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.826840] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.827440] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.827440] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.827440] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b403d6f4-9cfd-407a-9a3f-9a486dae20dc',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.829337] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.829481] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.829714] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-c518d277-32a1-437b-a0b2-37d4c69436b0 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.829835] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c518d277-32a1-437b-a0b2-37d4c69436b0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.965782] env[69232]: INFO networking_nsxv3.common.synchronization [req-51582c97-7803-403b-be47-6a22c921de30 req-b4191ed2-d6b1-4d5a-97e6-1de7190316e7 tempest-SecurityGroupsTestJSON-1763653160 tempest-SecurityGroupsTestJSON-1763653160-project-member] Enqueued Resource ID: 0a7a78fa-fad0-458c-afc2-e1d98c9176ab with Priority: HIGHEST for action security_group_rules [ 793.965952] env[69232]: INFO networking_nsxv3.common.synchronization [req-51582c97-7803-403b-be47-6a22c921de30 req-b4191ed2-d6b1-4d5a-97e6-1de7190316e7 tempest-SecurityGroupsTestJSON-1763653160 tempest-SecurityGroupsTestJSON-1763653160-project-member] Enqueued Resource ID: 0a7a78fa-fad0-458c-afc2-e1d98c9176ab with Priority: HIGHEST for action security_group_members [ 793.966104] env[69232]: INFO networking_nsxv3.common.synchronization [req-51582c97-7803-403b-be47-6a22c921de30 req-b4191ed2-d6b1-4d5a-97e6-1de7190316e7 tempest-SecurityGroupsTestJSON-1763653160 tempest-SecurityGroupsTestJSON-1763653160-project-member] Enqueued Resource ID: b403d6f4-9cfd-407a-9a3f-9a486dae20dc with Priority: HIGHEST for action security_group_rules [ 793.966232] env[69232]: INFO networking_nsxv3.common.synchronization [req-51582c97-7803-403b-be47-6a22c921de30 req-b4191ed2-d6b1-4d5a-97e6-1de7190316e7 tempest-SecurityGroupsTestJSON-1763653160 tempest-SecurityGroupsTestJSON-1763653160-project-member] Enqueued Resource ID: b403d6f4-9cfd-407a-9a3f-9a486dae20dc with Priority: HIGHEST for action security_group_members [ 793.966354] env[69232]: INFO networking_nsxv3.common.synchronization [req-51582c97-7803-403b-be47-6a22c921de30 req-b4191ed2-d6b1-4d5a-97e6-1de7190316e7 tempest-SecurityGroupsTestJSON-1763653160 tempest-SecurityGroupsTestJSON-1763653160-project-member] Enqueued Resource ID: c518d277-32a1-437b-a0b2-37d4c69436b0 with Priority: HIGHEST for action security_group_rules [ 793.966478] env[69232]: INFO networking_nsxv3.common.synchronization [req-51582c97-7803-403b-be47-6a22c921de30 req-b4191ed2-d6b1-4d5a-97e6-1de7190316e7 tempest-SecurityGroupsTestJSON-1763653160 tempest-SecurityGroupsTestJSON-1763653160-project-member] Enqueued Resource ID: c518d277-32a1-437b-a0b2-37d4c69436b0 with Priority: HIGHEST for action security_group_members [ 793.966591] env[69232]: INFO networking_nsxv3.common.synchronization [req-51582c97-7803-403b-be47-6a22c921de30 req-b4191ed2-d6b1-4d5a-97e6-1de7190316e7 tempest-SecurityGroupsTestJSON-1763653160 tempest-SecurityGroupsTestJSON-1763653160-project-member] Enqueued Resource ID: 89e8cb5f-6e55-49b9-953c-354eb5e5748f with Priority: HIGHEST for action port [ 793.967150] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a7a78fa-fad0-458c-afc2-e1d98c9176ab with Priority: HIGHEST for action security_group_rules [ 793.967292] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b403d6f4-9cfd-407a-9a3f-9a486dae20dc with Priority: HIGHEST for action security_group_rules [ 793.967386] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c518d277-32a1-437b-a0b2-37d4c69436b0 with Priority: HIGHEST for action security_group_members [ 793.967474] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 89e8cb5f-6e55-49b9-953c-354eb5e5748f with Priority: HIGHEST for action port [ 793.967596] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c518d277-32a1-437b-a0b2-37d4c69436b0 with Priority: HIGHEST for action security_group_rules [ 793.967658] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a7a78fa-fad0-458c-afc2-e1d98c9176ab with Priority: HIGHEST for action security_group_members [ 793.967719] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b403d6f4-9cfd-407a-9a3f-9a486dae20dc with Priority: HIGHEST for action security_group_members [ 793.968022] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0a7a78fa-fad0-458c-afc2-e1d98c9176ab taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.968133] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.968337] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b403d6f4-9cfd-407a-9a3f-9a486dae20dc taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.968528] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b403d6f4-9cfd-407a-9a3f-9a486dae20dc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.968528] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b403d6f4-9cfd-407a-9a3f-9a486dae20dc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.968839] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b403d6f4-9cfd-407a-9a3f-9a486dae20dc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.968891] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b403d6f4-9cfd-407a-9a3f-9a486dae20dc',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.970722] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-c518d277-32a1-437b-a0b2-37d4c69436b0 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.971498] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c518d277-32a1-437b-a0b2-37d4c69436b0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.971498] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-89e8cb5f-6e55-49b9-953c-354eb5e5748f taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.971498] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-89e8cb5f-6e55-49b9-953c-354eb5e5748f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.971498] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-89e8cb5f-6e55-49b9-953c-354eb5e5748f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.971498] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-89e8cb5f-6e55-49b9-953c-354eb5e5748f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.971706] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('89e8cb5f-6e55-49b9-953c-354eb5e5748f',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.975041] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c518d277-32a1-437b-a0b2-37d4c69436b0 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.975041] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c518d277-32a1-437b-a0b2-37d4c69436b0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.975041] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.975041] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.975041] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-b403d6f4-9cfd-407a-9a3f-9a486dae20dc taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.975041] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b403d6f4-9cfd-407a-9a3f-9a486dae20dc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.975491] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c518d277-32a1-437b-a0b2-37d4c69436b0',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.976441] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0a7a78fa-fad0-458c-afc2-e1d98c9176ab',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.331023] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b403d6f4-9cfd-407a-9a3f-9a486dae20dc',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.475344] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 89e8cb5f-6e55-49b9-953c-354eb5e5748f with status ACTIVE [ 794.475692] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.475896] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.476016] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.476322] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.476472] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.476740] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.476919] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.476994] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.477248] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.477382] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.477650] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.477801] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.477902] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.479852] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.479998] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.480143] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 89e8cb5f-6e55-49b9-953c-354eb5e5748f is going to be updated. [ 794.483072] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-b403d6f4-9cfd-407a-9a3f-9a486dae20dc taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.483209] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b403d6f4-9cfd-407a-9a3f-9a486dae20dc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.483642] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.483856] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.483935] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.484199] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.484326] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.484457] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c518d277-32a1-437b-a0b2-37d4c69436b0 is going to be created. [ 794.486061] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.486231] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.486331] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.486605] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.486740] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.486872] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a7a78fa-fad0-458c-afc2-e1d98c9176ab is going to be updated. [ 794.513951] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.514125] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.514844] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.514844] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.514844] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.514844] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-89e8cb5f-6e55-49b9-953c-354eb5e5748f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.527017] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.527017] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.527017] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.527241] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.527320] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.530293] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.530538] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.530684] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.531028] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.531246] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.548026] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a7a78fa-fad0-458c-afc2-e1d98c9176ab in Status: IN_PROGRESS for 2s [ 794.548026] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c518d277-32a1-437b-a0b2-37d4c69436b0 in Status: UNINITIALIZED for 2s [ 794.554514] env[69232]: INFO networking_nsxv3.common.synchronization [req-9c5f4789-ee07-48b2-8787-aaf8079a2437 req-4ea9b73d-d9c0-4b55-9222-bfcbac538592 tempest-ImagesTestJSON-1245210724 tempest-ImagesTestJSON-1245210724-project-member] Enqueued Resource ID: fb3494b9-4ce5-4744-a378-ecbcd5c2bec9 with Priority: HIGHEST for action security_group_members [ 794.555416] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb3494b9-4ce5-4744-a378-ecbcd5c2bec9 with Priority: HIGHEST for action security_group_members [ 794.555873] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.556125] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.556209] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.556504] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.557271] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.557271] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.557271] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.557271] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.557271] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.557526] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fb3494b9-4ce5-4744-a378-ecbcd5c2bec9',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.803666] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 256e29a3-9ff8-45a1-805b-591f83c2a8b4 in Status: SUCCESS [ 794.804133] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-256e29a3-9ff8-45a1-805b-591f83c2a8b4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.804133] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-256e29a3-9ff8-45a1-805b-591f83c2a8b4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.804452] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-256e29a3-9ff8-45a1-805b-591f83c2a8b4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.804648] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.804648] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.804648] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.805064] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.805179] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.805264] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-256e29a3-9ff8-45a1-805b-591f83c2a8b4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.805527] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('256e29a3-9ff8-45a1-805b-591f83c2a8b4',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.834727] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b403d6f4-9cfd-407a-9a3f-9a486dae20dc',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.919443] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d2391c01-2410-4874-a5a8-6da2d957e88c in Status: SUCCESS [ 794.920179] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d2391c01-2410-4874-a5a8-6da2d957e88c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.060104] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.060407] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.060457] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.061245] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.061305] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.061503] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.061609] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.061667] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.061848] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.061921] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.062021] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb3494b9-4ce5-4744-a378-ecbcd5c2bec9 is going to be updated. [ 795.095557] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.095738] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.095809] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.096018] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.096172] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.110641] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb3494b9-4ce5-4744-a378-ecbcd5c2bec9 in Status: IN_PROGRESS for 2s [ 795.149336] env[69232]: INFO networking_nsxv3.common.synchronization [req-f5c09c89-c6cb-4dcc-84e8-ed8eb1f615dd req-1acdf539-a947-4373-9dfa-d502fce03568 tempest-ServersTestManualDisk-382677829 tempest-ServersTestManualDisk-382677829-project-member] Enqueued Resource ID: 24c49db3-d2db-437b-976f-e83851ddd42c with Priority: HIGHEST for action security_group_members [ 795.150592] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24c49db3-d2db-437b-976f-e83851ddd42c with Priority: HIGHEST for action security_group_members [ 795.151046] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-24c49db3-d2db-437b-976f-e83851ddd42c taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.151215] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-24c49db3-d2db-437b-976f-e83851ddd42c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.151283] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-24c49db3-d2db-437b-976f-e83851ddd42c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.151599] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-24c49db3-d2db-437b-976f-e83851ddd42c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.151776] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.151907] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.151998] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.152196] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.152254] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.152350] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('24c49db3-d2db-437b-976f-e83851ddd42c',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.311060] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-256e29a3-9ff8-45a1-805b-591f83c2a8b4 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.311060] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-256e29a3-9ff8-45a1-805b-591f83c2a8b4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.311060] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-256e29a3-9ff8-45a1-805b-591f83c2a8b4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.311060] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-256e29a3-9ff8-45a1-805b-591f83c2a8b4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.311060] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.311060] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.311060] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.311060] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.311060] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.311060] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-256e29a3-9ff8-45a1-805b-591f83c2a8b4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.311060] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-256e29a3-9ff8-45a1-805b-591f83c2a8b4 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.311060] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-256e29a3-9ff8-45a1-805b-591f83c2a8b4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.311060] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-256e29a3-9ff8-45a1-805b-591f83c2a8b4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.311060] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-256e29a3-9ff8-45a1-805b-591f83c2a8b4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.311060] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.311060] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.312828] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.312828] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.312828] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.312828] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-256e29a3-9ff8-45a1-805b-591f83c2a8b4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.312828] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('256e29a3-9ff8-45a1-805b-591f83c2a8b4',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.322475] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock network-674 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.322651] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "network-674" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.322651] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "network-674" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.322940] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "network-674" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.323125] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.323298] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.323507] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.323630] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.323740] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.323943] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 795.328172] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] NeedRegenerationException {{(pid=69232) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 795.328423] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] no value, waiting for create lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 795.328550] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] value creation lock acquired {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 795.328679] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 795.328860] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Calling creation function for not-yet-present value {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 795.328936] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 795.337403] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.337532] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.338059] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.338300] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.338432] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.338538] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b403d6f4-9cfd-407a-9a3f-9a486dae20dc is going to be created. [ 795.354584] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 795.354838] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=69232) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 795.355097] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Released creation lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 795.355379] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "network-674" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.355808] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock port-4679c90d-e2aa-48eb-af00-c4430c1e5a2b taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.356564] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "port-4679c90d-e2aa-48eb-af00-c4430c1e5a2b" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.356564] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "port-4679c90d-e2aa-48eb-af00-c4430c1e5a2b" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.357127] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "port-4679c90d-e2aa-48eb-af00-c4430c1e5a2b" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.357127] env[69232]: DEBUG networking_nsxv3.api.rpc [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4679c90d-e2aa-48eb-af00-c4430c1e5a2b',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.368970] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.368970] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.369253] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.369314] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.369480] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.381617] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b403d6f4-9cfd-407a-9a3f-9a486dae20dc in Status: UNINITIALIZED for 2s [ 795.658041] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.658041] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.658041] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.658041] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.658041] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.658041] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.658041] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.658041] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.658041] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.658041] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.658041] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 24c49db3-d2db-437b-976f-e83851ddd42c is going to be updated. [ 795.677249] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f29e46f4-baa2-4512-b89f-bb8fa2c53157 in Status: SUCCESS [ 795.677487] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f29e46f4-baa2-4512-b89f-bb8fa2c53157" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.677737] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f29e46f4-baa2-4512-b89f-bb8fa2c53157" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.678018] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f29e46f4-baa2-4512-b89f-bb8fa2c53157" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.678332] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.678508] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.678622] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.678851] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.678979] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.679151] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f29e46f4-baa2-4512-b89f-bb8fa2c53157" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.679285] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f29e46f4-baa2-4512-b89f-bb8fa2c53157',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.699376] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.699515] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.699584] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.699795] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.699931] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.710627] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 24c49db3-d2db-437b-976f-e83851ddd42c in Status: IN_PROGRESS for 2s [ 795.816112] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 256e29a3-9ff8-45a1-805b-591f83c2a8b4: rpc.has_security_group_logging(os_id): False [ 795.847086] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.847086] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.847086] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.847086] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.847086] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.847086] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.847086] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.847086] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.847086] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.847086] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.847086] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.847086] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.847086] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.847086] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.847086] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.848630] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.848630] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.848630] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.848630] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.848630] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.848630] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 256e29a3-9ff8-45a1-805b-591f83c2a8b4 is going to be updated. [ 795.862227] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.862227] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.862227] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.862227] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.862227] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.862227] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Segment Port 4679c90d-e2aa-48eb-af00-c4430c1e5a2b not found, creating... [ 795.862227] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.862770] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.862770] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.862770] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.863592] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.865210] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.865210] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.865210] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.865210] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.865210] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.865210] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Resource: SegmentPort with ID: 4679c90d-e2aa-48eb-af00-c4430c1e5a2b is going to be created. [ 795.887673] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.887673] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.887673] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.887673] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.887673] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.887673] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "port-4679c90d-e2aa-48eb-af00-c4430c1e5a2b" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.930300] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.933864] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.933864] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.933864] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.933864] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.950861] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 256e29a3-9ff8-45a1-805b-591f83c2a8b4 in Status: IN_PROGRESS for 2s [ 796.184393] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f29e46f4-baa2-4512-b89f-bb8fa2c53157',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.553940] env[69232]: INFO networking_nsxv3.common.synchronization [None req-5c43927a-7caf-40f5-9186-a1b5cefe9e03 None None] Enqueued Resource ID: 989aa655-feb0-4be0-82ec-ac6a07119eeb with Priority: HIGHEST for action port [ 796.554270] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 989aa655-feb0-4be0-82ec-ac6a07119eeb with Priority: HIGHEST for action port [ 796.554937] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-989aa655-feb0-4be0-82ec-ac6a07119eeb taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.555779] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-989aa655-feb0-4be0-82ec-ac6a07119eeb" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.555896] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-989aa655-feb0-4be0-82ec-ac6a07119eeb" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.556202] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-989aa655-feb0-4be0-82ec-ac6a07119eeb" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.556292] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('989aa655-feb0-4be0-82ec-ac6a07119eeb',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.557933] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c518d277-32a1-437b-a0b2-37d4c69436b0 in Status: SUCCESS [ 796.558147] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c518d277-32a1-437b-a0b2-37d4c69436b0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.559017] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a7a78fa-fad0-458c-afc2-e1d98c9176ab in Status: SUCCESS [ 796.559199] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.560643] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c518d277-32a1-437b-a0b2-37d4c69436b0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.560643] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c518d277-32a1-437b-a0b2-37d4c69436b0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.560643] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.560643] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.560643] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.560643] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.560643] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.560643] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c518d277-32a1-437b-a0b2-37d4c69436b0',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.561373] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.561545] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.561710] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.561827] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.561884] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.562114] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.562114] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.562184] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0a7a78fa-fad0-458c-afc2-e1d98c9176ab',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.689575] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f29e46f4-baa2-4512-b89f-bb8fa2c53157: rpc.has_security_group_logging(os_id): False [ 796.708474] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.708663] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.708727] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.708911] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.708985] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.709276] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.709342] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.709389] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.709882] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.709882] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.709882] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f29e46f4-baa2-4512-b89f-bb8fa2c53157 is going to be created. [ 796.772545] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.772837] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.772837] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.772961] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.773158] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.784935] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f29e46f4-baa2-4512-b89f-bb8fa2c53157 in Status: IN_PROGRESS for 2s [ 797.066038] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c518d277-32a1-437b-a0b2-37d4c69436b0',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.069309] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 989aa655-feb0-4be0-82ec-ac6a07119eeb [ 797.069654] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.069843] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.071118] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.071771] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.071837] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.071946] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:989aa655-feb0-4be0-82ec-ac6a07119eeb already deleted. [ 797.072043] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-989aa655-feb0-4be0-82ec-ac6a07119eeb" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.076450] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0a7a78fa-fad0-458c-afc2-e1d98c9176ab',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.076450] env[69232]: INFO networking_nsxv3.common.synchronization [req-9c5f4789-ee07-48b2-8787-aaf8079a2437 req-efc1b312-116e-4c86-93b3-2b2a2bbc85d7 service nova] Enqueued Resource ID: fb3494b9-4ce5-4744-a378-ecbcd5c2bec9 with Priority: HIGHEST for action security_group_rules [ 797.076450] env[69232]: INFO networking_nsxv3.common.synchronization [req-9c5f4789-ee07-48b2-8787-aaf8079a2437 req-efc1b312-116e-4c86-93b3-2b2a2bbc85d7 service nova] Enqueued Resource ID: fb3494b9-4ce5-4744-a378-ecbcd5c2bec9 with Priority: HIGHEST for action security_group_members [ 797.076588] env[69232]: INFO networking_nsxv3.common.synchronization [req-9c5f4789-ee07-48b2-8787-aaf8079a2437 req-efc1b312-116e-4c86-93b3-2b2a2bbc85d7 service nova] Enqueued Resource ID: 4679c90d-e2aa-48eb-af00-c4430c1e5a2b with Priority: HIGHEST for action port [ 797.077411] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb3494b9-4ce5-4744-a378-ecbcd5c2bec9 with Priority: HIGHEST for action security_group_rules [ 797.077666] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb3494b9-4ce5-4744-a378-ecbcd5c2bec9 with Priority: HIGHEST for action security_group_members [ 797.077855] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4679c90d-e2aa-48eb-af00-c4430c1e5a2b with Priority: HIGHEST for action port [ 797.080454] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.080712] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.080793] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.080995] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.081096] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fb3494b9-4ce5-4744-a378-ecbcd5c2bec9',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.081926] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.082890] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.083974] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-4679c90d-e2aa-48eb-af00-c4430c1e5a2b taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.083974] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4679c90d-e2aa-48eb-af00-c4430c1e5a2b" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.083974] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4679c90d-e2aa-48eb-af00-c4430c1e5a2b" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.083974] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4679c90d-e2aa-48eb-af00-c4430c1e5a2b" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.083974] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4679c90d-e2aa-48eb-af00-c4430c1e5a2b',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.119827] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb3494b9-4ce5-4744-a378-ecbcd5c2bec9 in Status: SUCCESS [ 797.119972] env[69232]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb3494b9-4ce5-4744-a378-ecbcd5c2bec9 deletion is rescheduled due to dependency. [ 797.122017] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.122017] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.122017] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.122017] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.122017] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.122017] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.122017] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.122017] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.122017] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fb3494b9-4ce5-4744-a378-ecbcd5c2bec9',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.392444] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b403d6f4-9cfd-407a-9a3f-9a486dae20dc in Status: SUCCESS [ 797.392945] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b403d6f4-9cfd-407a-9a3f-9a486dae20dc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.393634] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b403d6f4-9cfd-407a-9a3f-9a486dae20dc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.394243] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b403d6f4-9cfd-407a-9a3f-9a486dae20dc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.394462] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.394665] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.394851] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.395103] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.395211] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.395446] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b403d6f4-9cfd-407a-9a3f-9a486dae20dc',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.579463] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c518d277-32a1-437b-a0b2-37d4c69436b0',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.580810] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0a7a78fa-fad0-458c-afc2-e1d98c9176ab',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.585784] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.587370] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.587370] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4679c90d-e2aa-48eb-af00-c4430c1e5a2b with status ACTIVE [ 797.587370] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.587370] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.587370] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.587370] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.587370] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.587370] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.587685] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.587685] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.587685] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.587783] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.588545] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.588545] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.588545] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.588545] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.588545] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.588545] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4679c90d-e2aa-48eb-af00-c4430c1e5a2b is going to be updated. [ 797.614564] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.614564] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.614564] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.614564] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.614564] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.614564] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4679c90d-e2aa-48eb-af00-c4430c1e5a2b" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.626186] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fb3494b9-4ce5-4744-a378-ecbcd5c2bec9',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.724223] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 24c49db3-d2db-437b-976f-e83851ddd42c in Status: SUCCESS [ 797.724223] env[69232]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 24c49db3-d2db-437b-976f-e83851ddd42c deletion is rescheduled due to dependency. [ 797.724223] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-24c49db3-d2db-437b-976f-e83851ddd42c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.897942] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b403d6f4-9cfd-407a-9a3f-9a486dae20dc',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.968501] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 256e29a3-9ff8-45a1-805b-591f83c2a8b4 in Status: SUCCESS [ 797.968501] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-256e29a3-9ff8-45a1-805b-591f83c2a8b4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.083230] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.083230] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.083230] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.083230] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.083230] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.083230] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c518d277-32a1-437b-a0b2-37d4c69436b0 is going to be updated. [ 798.086020] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.086173] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.086240] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.086436] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.086521] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.086613] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a7a78fa-fad0-458c-afc2-e1d98c9176ab is going to be updated. [ 798.129386] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.129540] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.129613] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.129829] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.129972] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.131103] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fb3494b9-4ce5-4744-a378-ecbcd5c2bec9',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.133432] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.133563] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.133633] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.133821] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.133961] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.149157] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a7a78fa-fad0-458c-afc2-e1d98c9176ab in Status: IN_PROGRESS for 2s [ 798.149157] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c518d277-32a1-437b-a0b2-37d4c69436b0 in Status: IN_PROGRESS for 2s [ 798.152372] env[69232]: INFO networking_nsxv3.common.synchronization [None req-b118e070-97cb-4b53-b9bb-54aeb57fd552 tempest-ServerActionsTestOtherA-781098598 tempest-ServerActionsTestOtherA-781098598-project-member] Enqueued Resource ID: 3e5e65a3-941b-4419-9265-0dce9e80179e with Priority: HIGHEST for action security_group_rules [ 798.153041] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e5e65a3-941b-4419-9265-0dce9e80179e with Priority: HIGHEST for action security_group_rules [ 798.153505] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3e5e65a3-941b-4419-9265-0dce9e80179e taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.153505] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3e5e65a3-941b-4419-9265-0dce9e80179e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.153505] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3e5e65a3-941b-4419-9265-0dce9e80179e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.153675] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3e5e65a3-941b-4419-9265-0dce9e80179e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.153710] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3e5e65a3-941b-4419-9265-0dce9e80179e',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.377190] env[69232]: INFO networking_nsxv3.common.synchronization [None req-075573ba-b578-49c4-bbc8-83dc8c0cd2ea tempest-ServerActionsTestOtherA-781098598 tempest-ServerActionsTestOtherA-781098598-project-member] Enqueued Resource ID: 3e5e65a3-941b-4419-9265-0dce9e80179e with Priority: HIGHEST for action security_group_rules [ 798.377190] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e5e65a3-941b-4419-9265-0dce9e80179e with Priority: HIGHEST for action security_group_rules [ 798.377190] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3e5e65a3-941b-4419-9265-0dce9e80179e taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.377190] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3e5e65a3-941b-4419-9265-0dce9e80179e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.403747] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b403d6f4-9cfd-407a-9a3f-9a486dae20dc',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.636223] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.636379] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.636446] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.636686] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.636991] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.636991] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb3494b9-4ce5-4744-a378-ecbcd5c2bec9 is going to be updated. [ 798.683657] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.683828] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.683938] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.684204] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.684299] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.684398] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3e5e65a3-941b-4419-9265-0dce9e80179e already deleted. [ 798.684483] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3e5e65a3-941b-4419-9265-0dce9e80179e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.684637] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3e5e65a3-941b-4419-9265-0dce9e80179e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.684795] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3e5e65a3-941b-4419-9265-0dce9e80179e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.684882] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3e5e65a3-941b-4419-9265-0dce9e80179e',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.705487] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.708220] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.708220] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.708220] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.708220] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.725763] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb3494b9-4ce5-4744-a378-ecbcd5c2bec9 in Status: IN_PROGRESS for 2s [ 798.798554] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f29e46f4-baa2-4512-b89f-bb8fa2c53157 in Status: SUCCESS [ 798.799741] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f29e46f4-baa2-4512-b89f-bb8fa2c53157" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.908230] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.908230] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.908230] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.908637] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.908768] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.908900] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b403d6f4-9cfd-407a-9a3f-9a486dae20dc is going to be updated. [ 798.943619] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.943619] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.943619] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.943915] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.943990] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.954368] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b403d6f4-9cfd-407a-9a3f-9a486dae20dc in Status: IN_PROGRESS for 2s [ 799.213497] env[69232]: INFO networking_nsxv3.common.synchronization [None req-f207ba66-868b-4a0b-8d2d-2791476409f9 None None] Enqueued Resource ID: 1c428cc7-fff1-44d6-8744-f6f6214a7387 with Priority: HIGHEST for action port [ 799.213497] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.213497] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.213497] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.213497] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.213497] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.213497] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3e5e65a3-941b-4419-9265-0dce9e80179e already deleted. [ 799.213497] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3e5e65a3-941b-4419-9265-0dce9e80179e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.213497] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c428cc7-fff1-44d6-8744-f6f6214a7387 with Priority: HIGHEST for action port [ 799.214509] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-1c428cc7-fff1-44d6-8744-f6f6214a7387 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.215526] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1c428cc7-fff1-44d6-8744-f6f6214a7387" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.216726] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1c428cc7-fff1-44d6-8744-f6f6214a7387" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.217126] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1c428cc7-fff1-44d6-8744-f6f6214a7387" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.217363] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1c428cc7-fff1-44d6-8744-f6f6214a7387',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.721357] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1c428cc7-fff1-44d6-8744-f6f6214a7387 [ 799.722668] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.723157] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.723157] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.723522] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.723522] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.724079] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1c428cc7-fff1-44d6-8744-f6f6214a7387 already deleted. [ 799.724079] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1c428cc7-fff1-44d6-8744-f6f6214a7387" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.159623] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a7a78fa-fad0-458c-afc2-e1d98c9176ab in Status: SUCCESS [ 800.159623] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.159623] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.159623] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.159623] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.159815] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.159920] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.160064] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.160143] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.160334] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.160418] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0a7a78fa-fad0-458c-afc2-e1d98c9176ab',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.162115] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c518d277-32a1-437b-a0b2-37d4c69436b0 in Status: SUCCESS [ 800.162357] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c518d277-32a1-437b-a0b2-37d4c69436b0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.162590] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.162939] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.163214] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.163377] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.163491] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.163701] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.163812] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.163951] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0a7a78fa-fad0-458c-afc2-e1d98c9176ab',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.166872] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c518d277-32a1-437b-a0b2-37d4c69436b0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.166872] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c518d277-32a1-437b-a0b2-37d4c69436b0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.166872] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.166872] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.166872] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.166872] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.166872] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.166872] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c518d277-32a1-437b-a0b2-37d4c69436b0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.166872] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c518d277-32a1-437b-a0b2-37d4c69436b0',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.166872] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c518d277-32a1-437b-a0b2-37d4c69436b0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.166872] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c518d277-32a1-437b-a0b2-37d4c69436b0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.169225] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.169352] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.169415] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.169583] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.169670] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.169758] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c518d277-32a1-437b-a0b2-37d4c69436b0',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.668501] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.668820] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.672064] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0a7a78fa-fad0-458c-afc2-e1d98c9176ab',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.673063] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c518d277-32a1-437b-a0b2-37d4c69436b0',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.673986] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c518d277-32a1-437b-a0b2-37d4c69436b0',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.741908] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb3494b9-4ce5-4744-a378-ecbcd5c2bec9 in Status: SUCCESS [ 800.742596] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.742596] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.742789] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.742871] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.742985] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.743062] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.743351] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.743351] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.743531] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.743603] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fb3494b9-4ce5-4744-a378-ecbcd5c2bec9',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.968706] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b403d6f4-9cfd-407a-9a3f-9a486dae20dc in Status: SUCCESS [ 800.969011] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b403d6f4-9cfd-407a-9a3f-9a486dae20dc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.969204] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b403d6f4-9cfd-407a-9a3f-9a486dae20dc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.969491] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b403d6f4-9cfd-407a-9a3f-9a486dae20dc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.969685] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.969800] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.969857] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.970017] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.970103] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.970187] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b403d6f4-9cfd-407a-9a3f-9a486dae20dc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.970280] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b403d6f4-9cfd-407a-9a3f-9a486dae20dc',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.177276] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c518d277-32a1-437b-a0b2-37d4c69436b0: rpc.has_security_group_logging(os_id): False [ 801.177787] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0a7a78fa-fad0-458c-afc2-e1d98c9176ab',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.179137] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c518d277-32a1-437b-a0b2-37d4c69436b0',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.200496] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.200496] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.200496] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.200496] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.200496] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.200496] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.200496] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.200496] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.200496] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.200496] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.200496] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c518d277-32a1-437b-a0b2-37d4c69436b0 is going to be created. [ 801.248602] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.248602] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.248602] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.248602] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.248602] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.248602] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.248602] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.248602] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.248602] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.248602] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.248602] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.248602] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.248602] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.248602] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.248602] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.248602] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.249474] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.249474] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.249474] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.249474] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.249474] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fb3494b9-4ce5-4744-a378-ecbcd5c2bec9',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.266482] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.266482] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.266482] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.266482] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.266482] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.278423] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c518d277-32a1-437b-a0b2-37d4c69436b0 in Status: IN_PROGRESS for 2s [ 801.475147] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b403d6f4-9cfd-407a-9a3f-9a486dae20dc',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.681815] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.682123] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.682444] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.682993] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.683139] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.683271] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a7a78fa-fad0-458c-afc2-e1d98c9176ab is going to be updated. [ 801.685352] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.685527] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.685607] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.685852] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.686090] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.686247] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c518d277-32a1-437b-a0b2-37d4c69436b0 is going to be updated. [ 801.715718] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.715875] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.715929] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.716162] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.716303] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.718264] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.718504] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.718643] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.718955] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.719131] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.732613] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a7a78fa-fad0-458c-afc2-e1d98c9176ab in Status: IN_PROGRESS for 2s [ 801.733217] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c518d277-32a1-437b-a0b2-37d4c69436b0 in Status: IN_PROGRESS for 2s [ 801.753945] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fb3494b9-4ce5-4744-a378-ecbcd5c2bec9: rpc.has_security_group_logging(os_id): False [ 801.779508] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.779678] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.779757] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.779953] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.780057] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.780256] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.780423] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.780490] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.780649] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.780730] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.780927] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.781816] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.781950] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.782131] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.782214] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.782426] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.782526] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.782600] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.782736] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.782812] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.782898] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fb3494b9-4ce5-4744-a378-ecbcd5c2bec9 is going to be updated. [ 801.853024] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.853024] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.853024] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.853024] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.853024] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.867892] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fb3494b9-4ce5-4744-a378-ecbcd5c2bec9 in Status: IN_PROGRESS for 2s [ 801.978279] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b403d6f4-9cfd-407a-9a3f-9a486dae20dc: rpc.has_security_group_logging(os_id): False [ 802.003193] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.003393] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.003476] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.004081] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.004081] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.004081] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.004081] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.004081] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.004329] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.004329] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.004452] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b403d6f4-9cfd-407a-9a3f-9a486dae20dc is going to be created. [ 802.068044] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.068221] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.068269] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.068484] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.068656] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.080211] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b403d6f4-9cfd-407a-9a3f-9a486dae20dc in Status: IN_PROGRESS for 2s [ 802.377472] env[69232]: INFO networking_nsxv3.common.synchronization [None req-630e28e7-54b2-4552-ad70-db161e335e2d None None] Enqueued Resource ID: d0f46be2-dd74-481f-ad15-5926b5e64aaf with Priority: HIGHEST for action port [ 802.377722] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0f46be2-dd74-481f-ad15-5926b5e64aaf with Priority: HIGHEST for action port [ 802.378345] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-d0f46be2-dd74-481f-ad15-5926b5e64aaf taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.378467] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d0f46be2-dd74-481f-ad15-5926b5e64aaf" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.378553] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d0f46be2-dd74-481f-ad15-5926b5e64aaf" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.378790] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d0f46be2-dd74-481f-ad15-5926b5e64aaf" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.378875] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d0f46be2-dd74-481f-ad15-5926b5e64aaf',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.882983] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d0f46be2-dd74-481f-ad15-5926b5e64aaf [ 802.883369] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.883467] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.883556] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.883957] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.884147] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.884325] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d0f46be2-dd74-481f-ad15-5926b5e64aaf already deleted. [ 802.884486] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d0f46be2-dd74-481f-ad15-5926b5e64aaf" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.292095] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c518d277-32a1-437b-a0b2-37d4c69436b0 in Status: SUCCESS [ 803.292361] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c518d277-32a1-437b-a0b2-37d4c69436b0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.292596] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c518d277-32a1-437b-a0b2-37d4c69436b0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.292806] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c518d277-32a1-437b-a0b2-37d4c69436b0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.292900] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c518d277-32a1-437b-a0b2-37d4c69436b0',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.746534] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c518d277-32a1-437b-a0b2-37d4c69436b0 in Status: SUCCESS [ 803.746771] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c518d277-32a1-437b-a0b2-37d4c69436b0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.746948] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c518d277-32a1-437b-a0b2-37d4c69436b0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.747183] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c518d277-32a1-437b-a0b2-37d4c69436b0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.747367] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.747483] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.747547] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.747714] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.747811] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.747868] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c518d277-32a1-437b-a0b2-37d4c69436b0',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.749470] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a7a78fa-fad0-458c-afc2-e1d98c9176ab in Status: SUCCESS [ 803.749655] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.749804] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.749970] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.750142] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.750245] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.750381] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.750484] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.750561] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.750650] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0a7a78fa-fad0-458c-afc2-e1d98c9176ab',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.797695] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-c518d277-32a1-437b-a0b2-37d4c69436b0 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.797695] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c518d277-32a1-437b-a0b2-37d4c69436b0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.881170] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fb3494b9-4ce5-4744-a378-ecbcd5c2bec9 in Status: SUCCESS [ 803.881271] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.094153] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b403d6f4-9cfd-407a-9a3f-9a486dae20dc in Status: SUCCESS [ 804.094153] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b403d6f4-9cfd-407a-9a3f-9a486dae20dc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.254169] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c518d277-32a1-437b-a0b2-37d4c69436b0',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.254169] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0a7a78fa-fad0-458c-afc2-e1d98c9176ab',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.555629] env[69232]: INFO networking_nsxv3.common.synchronization [None req-4be0e819-72de-4281-9a32-7ea206e9b339 tempest-ImagesOneServerNegativeTestJSON-501782696 tempest-ImagesOneServerNegativeTestJSON-501782696-project-member] Enqueued Resource ID: e90084c6-eeee-4bed-bc83-c3578c9f3945 with Priority: HIGHEST for action security_group_rules [ 804.555790] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e90084c6-eeee-4bed-bc83-c3578c9f3945 with Priority: HIGHEST for action security_group_rules [ 804.556184] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e90084c6-eeee-4bed-bc83-c3578c9f3945 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.556278] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e90084c6-eeee-4bed-bc83-c3578c9f3945" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.556278] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e90084c6-eeee-4bed-bc83-c3578c9f3945" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.557221] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e90084c6-eeee-4bed-bc83-c3578c9f3945" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.557221] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e90084c6-eeee-4bed-bc83-c3578c9f3945',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.714255] env[69232]: INFO networking_nsxv3.common.synchronization [None req-17c70995-b258-4b8c-ac4c-72508ebd5493 tempest-ImagesOneServerNegativeTestJSON-501782696 tempest-ImagesOneServerNegativeTestJSON-501782696-project-member] Enqueued Resource ID: e90084c6-eeee-4bed-bc83-c3578c9f3945 with Priority: HIGHEST for action security_group_rules [ 804.714812] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e90084c6-eeee-4bed-bc83-c3578c9f3945 with Priority: HIGHEST for action security_group_rules [ 804.715631] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e90084c6-eeee-4bed-bc83-c3578c9f3945 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.715631] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e90084c6-eeee-4bed-bc83-c3578c9f3945" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.758625] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c518d277-32a1-437b-a0b2-37d4c69436b0',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.759863] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0a7a78fa-fad0-458c-afc2-e1d98c9176ab',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.897493] env[69232]: INFO networking_nsxv3.common.synchronization [None req-be79ddf6-40e5-4f39-94dc-7ccf4fff3c09 None None] Enqueued Resource ID: 2ebae5e5-ae25-4674-8291-a16d3b7598af with Priority: HIGHEST for action port [ 804.897776] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ebae5e5-ae25-4674-8291-a16d3b7598af with Priority: HIGHEST for action port [ 804.898391] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-2ebae5e5-ae25-4674-8291-a16d3b7598af taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.898526] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2ebae5e5-ae25-4674-8291-a16d3b7598af" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.898591] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2ebae5e5-ae25-4674-8291-a16d3b7598af" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.898854] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2ebae5e5-ae25-4674-8291-a16d3b7598af" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.899103] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2ebae5e5-ae25-4674-8291-a16d3b7598af',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.096697] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.098137] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.098508] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.098651] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.098651] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.098799] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e90084c6-eeee-4bed-bc83-c3578c9f3945 already deleted. [ 805.098897] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e90084c6-eeee-4bed-bc83-c3578c9f3945" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.099186] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e90084c6-eeee-4bed-bc83-c3578c9f3945" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.099376] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e90084c6-eeee-4bed-bc83-c3578c9f3945" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.099597] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e90084c6-eeee-4bed-bc83-c3578c9f3945',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.265414] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.266086] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.266304] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.266702] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.267487] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.267613] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c518d277-32a1-437b-a0b2-37d4c69436b0 is going to be updated. [ 805.268985] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.269128] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.269185] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.269393] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.269465] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.269519] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a7a78fa-fad0-458c-afc2-e1d98c9176ab is going to be updated. [ 805.311507] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.311756] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.311897] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.312367] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.312613] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.314441] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.314635] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.314635] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.314853] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.314985] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.330027] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a7a78fa-fad0-458c-afc2-e1d98c9176ab in Status: IN_PROGRESS for 2s [ 805.330709] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c518d277-32a1-437b-a0b2-37d4c69436b0 in Status: IN_PROGRESS for 2s [ 805.405136] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2ebae5e5-ae25-4674-8291-a16d3b7598af [ 805.405606] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.405793] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.405880] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.406180] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.406346] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.406513] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2ebae5e5-ae25-4674-8291-a16d3b7598af already deleted. [ 805.406612] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2ebae5e5-ae25-4674-8291-a16d3b7598af" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.621210] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.621436] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.621436] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.622228] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.622228] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.622228] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e90084c6-eeee-4bed-bc83-c3578c9f3945 already deleted. [ 805.622228] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e90084c6-eeee-4bed-bc83-c3578c9f3945" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.856878] env[69232]: INFO networking_nsxv3.common.synchronization [req-e005c081-a32a-411e-a0ac-858eebfc9157 req-78e70fcb-785f-4520-b841-8c4828c9b68f tempest-VolumesAdminNegativeTest-609403025 tempest-VolumesAdminNegativeTest-609403025-project-member] Enqueued Resource ID: 390cb592-453e-4228-83b2-b1b29ea598c8 with Priority: HIGHEST for action security_group_members [ 806.857637] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 390cb592-453e-4228-83b2-b1b29ea598c8 with Priority: HIGHEST for action security_group_members [ 806.857952] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-390cb592-453e-4228-83b2-b1b29ea598c8 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.858092] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-390cb592-453e-4228-83b2-b1b29ea598c8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.858162] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-390cb592-453e-4228-83b2-b1b29ea598c8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.858474] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-390cb592-453e-4228-83b2-b1b29ea598c8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.858644] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.858914] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.859016] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.859243] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.859426] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.859508] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('390cb592-453e-4228-83b2-b1b29ea598c8',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.992574] env[69232]: INFO networking_nsxv3.common.synchronization [req-90d44680-b382-480b-9c44-caddadb57a72 req-c485e57e-5ca3-46ff-9169-82c496808bfa tempest-ServersAdminNegativeTestJSON-879816592 tempest-ServersAdminNegativeTestJSON-879816592-project-member] Enqueued Resource ID: 256e29a3-9ff8-45a1-805b-591f83c2a8b4 with Priority: HIGHEST for action security_group_members [ 806.993099] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 256e29a3-9ff8-45a1-805b-591f83c2a8b4 with Priority: HIGHEST for action security_group_members [ 806.993390] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-256e29a3-9ff8-45a1-805b-591f83c2a8b4 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.993585] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-256e29a3-9ff8-45a1-805b-591f83c2a8b4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.993674] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-256e29a3-9ff8-45a1-805b-591f83c2a8b4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.993847] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-256e29a3-9ff8-45a1-805b-591f83c2a8b4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.993997] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.994306] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.994306] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.994471] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.994554] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.994659] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('256e29a3-9ff8-45a1-805b-591f83c2a8b4',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.253802] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock network-246 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.254012] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "network-246" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.254141] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "network-246" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.254411] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "network-246" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.254933] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.254933] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.254933] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.255188] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.255279] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.256048] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 807.256048] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] NeedRegenerationException {{(pid=69232) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 807.256048] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] no value, waiting for create lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 807.256048] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] value creation lock acquired {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 807.256048] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 807.256048] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Calling creation function for not-yet-present value {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 807.256359] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 807.275721] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 807.275888] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69232) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 807.276039] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Released creation lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 807.276222] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "network-246" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.276553] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock port-753d22f3-8349-4c05-bf97-593f2bea76ee taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.276692] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "port-753d22f3-8349-4c05-bf97-593f2bea76ee" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.276812] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "port-753d22f3-8349-4c05-bf97-593f2bea76ee" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.277150] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "port-753d22f3-8349-4c05-bf97-593f2bea76ee" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.277289] env[69232]: DEBUG networking_nsxv3.api.rpc [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('753d22f3-8349-4c05-bf97-593f2bea76ee',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.342786] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c518d277-32a1-437b-a0b2-37d4c69436b0 in Status: SUCCESS [ 807.342986] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c518d277-32a1-437b-a0b2-37d4c69436b0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.343180] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c518d277-32a1-437b-a0b2-37d4c69436b0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.343393] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c518d277-32a1-437b-a0b2-37d4c69436b0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.343579] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.343693] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.343759] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.343913] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.343997] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.344133] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c518d277-32a1-437b-a0b2-37d4c69436b0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.344192] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c518d277-32a1-437b-a0b2-37d4c69436b0',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.345729] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a7a78fa-fad0-458c-afc2-e1d98c9176ab in Status: SUCCESS [ 807.345908] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.346072] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.346250] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.346546] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.346546] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.346871] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.346871] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.346871] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.347086] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.347086] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.347173] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.347211] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.347994] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.347994] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.347994] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.347994] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.347994] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.347994] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.347994] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.347994] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0a7a78fa-fad0-458c-afc2-e1d98c9176ab',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.362743] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.363140] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.363140] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.363249] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.363288] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.363476] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.363580] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.363973] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.363973] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.364117] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.364235] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 390cb592-453e-4228-83b2-b1b29ea598c8 already deleted. [ 807.364326] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-390cb592-453e-4228-83b2-b1b29ea598c8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.497818] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('256e29a3-9ff8-45a1-805b-591f83c2a8b4',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.781342] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.781520] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.781625] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.781909] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.782107] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.782234] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Segment Port 753d22f3-8349-4c05-bf97-593f2bea76ee not found, creating... [ 807.782486] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.782641] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.782940] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.783220] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.783370] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.783680] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.783886] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.783966] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.784200] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.784334] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.784474] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Resource: SegmentPort with ID: 753d22f3-8349-4c05-bf97-593f2bea76ee is going to be created. [ 807.807459] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.807676] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.807800] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.808080] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.808319] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.808531] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "port-753d22f3-8349-4c05-bf97-593f2bea76ee" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.850283] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c518d277-32a1-437b-a0b2-37d4c69436b0',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.851308] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0a7a78fa-fad0-458c-afc2-e1d98c9176ab: rpc.has_security_group_logging(os_id): False [ 807.880570] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.880853] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.880853] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.881027] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.881104] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.881382] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.881382] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.881510] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.881611] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.881688] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.881882] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.881976] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.882051] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.882192] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.882268] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.882483] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.882671] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.882724] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.882868] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.882943] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.883069] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0a7a78fa-fad0-458c-afc2-e1d98c9176ab is going to be updated. [ 807.999573] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('256e29a3-9ff8-45a1-805b-591f83c2a8b4',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.024502] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.024690] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.024690] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.025035] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.025035] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.042786] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0a7a78fa-fad0-458c-afc2-e1d98c9176ab in Status: IN_PROGRESS for 2s [ 808.353907] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c518d277-32a1-437b-a0b2-37d4c69436b0: rpc.has_security_group_logging(os_id): False [ 808.380967] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.381200] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.381200] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.381417] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.381588] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.381752] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.381854] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.381919] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.382108] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.382186] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.382275] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c518d277-32a1-437b-a0b2-37d4c69436b0 is going to be updated. [ 808.446549] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.446739] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.446808] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.447039] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.447182] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.461698] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c518d277-32a1-437b-a0b2-37d4c69436b0 in Status: IN_PROGRESS for 2s [ 808.502481] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.502847] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.502847] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.503101] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.503239] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.503374] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 256e29a3-9ff8-45a1-805b-591f83c2a8b4 is going to be updated. [ 808.574441] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.574441] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.574594] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.574779] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.575329] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.592866] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 256e29a3-9ff8-45a1-805b-591f83c2a8b4 in Status: IN_PROGRESS for 2s [ 808.699233] env[69232]: INFO networking_nsxv3.common.synchronization [req-e005c081-a32a-411e-a0ac-858eebfc9157 req-a6900c52-021d-47d9-a3df-47cbd010ac72 service nova] Enqueued Resource ID: 390cb592-453e-4228-83b2-b1b29ea598c8 with Priority: HIGHEST for action security_group_rules [ 808.699425] env[69232]: INFO networking_nsxv3.common.synchronization [req-e005c081-a32a-411e-a0ac-858eebfc9157 req-a6900c52-021d-47d9-a3df-47cbd010ac72 service nova] Enqueued Resource ID: 390cb592-453e-4228-83b2-b1b29ea598c8 with Priority: HIGHEST for action security_group_members [ 808.699560] env[69232]: INFO networking_nsxv3.common.synchronization [req-e005c081-a32a-411e-a0ac-858eebfc9157 req-a6900c52-021d-47d9-a3df-47cbd010ac72 service nova] Enqueued Resource ID: 753d22f3-8349-4c05-bf97-593f2bea76ee with Priority: HIGHEST for action port [ 808.702491] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 390cb592-453e-4228-83b2-b1b29ea598c8 with Priority: HIGHEST for action security_group_rules [ 808.702592] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 390cb592-453e-4228-83b2-b1b29ea598c8 with Priority: HIGHEST for action security_group_members [ 808.702649] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 753d22f3-8349-4c05-bf97-593f2bea76ee with Priority: HIGHEST for action port [ 808.703415] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-390cb592-453e-4228-83b2-b1b29ea598c8 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.703583] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-390cb592-453e-4228-83b2-b1b29ea598c8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.703646] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-390cb592-453e-4228-83b2-b1b29ea598c8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.703888] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-390cb592-453e-4228-83b2-b1b29ea598c8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.703980] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('390cb592-453e-4228-83b2-b1b29ea598c8',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.705045] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-390cb592-453e-4228-83b2-b1b29ea598c8 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.705178] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-390cb592-453e-4228-83b2-b1b29ea598c8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.705288] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-390cb592-453e-4228-83b2-b1b29ea598c8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.705446] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-390cb592-453e-4228-83b2-b1b29ea598c8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.705621] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.705730] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.705826] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.706054] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.706151] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.706255] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('390cb592-453e-4228-83b2-b1b29ea598c8',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.707280] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-753d22f3-8349-4c05-bf97-593f2bea76ee taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.707360] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-753d22f3-8349-4c05-bf97-593f2bea76ee" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.708773] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-753d22f3-8349-4c05-bf97-593f2bea76ee" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.708773] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-753d22f3-8349-4c05-bf97-593f2bea76ee" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.708773] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('753d22f3-8349-4c05-bf97-593f2bea76ee',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.213404] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-390cb592-453e-4228-83b2-b1b29ea598c8 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.213723] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-390cb592-453e-4228-83b2-b1b29ea598c8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.213723] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('390cb592-453e-4228-83b2-b1b29ea598c8',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.215310] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 753d22f3-8349-4c05-bf97-593f2bea76ee with status ACTIVE [ 809.216082] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.216082] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.216082] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.216082] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.216566] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.216566] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.216566] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.216566] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.216840] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.216840] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.216840] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.217014] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.217014] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.218232] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.218232] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.218232] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 753d22f3-8349-4c05-bf97-593f2bea76ee is going to be updated. [ 809.241470] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.241470] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.241470] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.241470] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.241470] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.241757] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-753d22f3-8349-4c05-bf97-593f2bea76ee" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.716394] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('390cb592-453e-4228-83b2-b1b29ea598c8',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.058613] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0a7a78fa-fad0-458c-afc2-e1d98c9176ab in Status: SUCCESS [ 810.058946] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.059165] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.059419] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.059537] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0a7a78fa-fad0-458c-afc2-e1d98c9176ab',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.218690] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.219084] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.219084] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.219179] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.219179] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.219276] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 390cb592-453e-4228-83b2-b1b29ea598c8 is going to be created. [ 810.247177] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.247355] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.247402] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.247610] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.247808] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.258333] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 390cb592-453e-4228-83b2-b1b29ea598c8 in Status: UNINITIALIZED for 2s [ 810.477033] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c518d277-32a1-437b-a0b2-37d4c69436b0 in Status: SUCCESS [ 810.477033] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c518d277-32a1-437b-a0b2-37d4c69436b0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.562708] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.562887] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.562952] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.563176] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.563348] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.563447] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.563502] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.563663] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.564273] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.564273] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.564273] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0a7a78fa-fad0-458c-afc2-e1d98c9176ab',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.602992] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 256e29a3-9ff8-45a1-805b-591f83c2a8b4 in Status: SUCCESS [ 810.603222] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-256e29a3-9ff8-45a1-805b-591f83c2a8b4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.067172] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.067355] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.067429] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.067662] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.067843] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.067949] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.068023] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.068175] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.068279] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.068372] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.068517] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.068628] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.068685] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.068842] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.068982] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.069097] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.069160] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.069299] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.069391] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.069476] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.069567] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0a7a78fa-fad0-458c-afc2-e1d98c9176ab',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.571606] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0a7a78fa-fad0-458c-afc2-e1d98c9176ab: rpc.has_security_group_logging(os_id): False [ 811.589704] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.589850] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.589921] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.590156] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.590249] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.590505] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.590610] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.590674] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.590827] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.590904] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.591118] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.591214] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.591277] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.591434] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.591544] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.591724] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.591823] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.591870] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.592013] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.592089] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.592171] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0a7a78fa-fad0-458c-afc2-e1d98c9176ab is going to be updated. [ 811.664325] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.664325] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.664485] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.664722] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.664821] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.682588] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0a7a78fa-fad0-458c-afc2-e1d98c9176ab in Status: IN_PROGRESS for 2s [ 812.269093] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 390cb592-453e-4228-83b2-b1b29ea598c8 in Status: SUCCESS [ 812.269899] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-390cb592-453e-4228-83b2-b1b29ea598c8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.269899] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-390cb592-453e-4228-83b2-b1b29ea598c8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.270109] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-390cb592-453e-4228-83b2-b1b29ea598c8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.270268] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.271040] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.271040] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.271040] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.271040] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.271040] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-390cb592-453e-4228-83b2-b1b29ea598c8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.271040] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('390cb592-453e-4228-83b2-b1b29ea598c8',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.777326] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-390cb592-453e-4228-83b2-b1b29ea598c8 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.777326] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-390cb592-453e-4228-83b2-b1b29ea598c8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.777326] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-390cb592-453e-4228-83b2-b1b29ea598c8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.777326] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-390cb592-453e-4228-83b2-b1b29ea598c8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.777326] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.777326] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.777326] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.777326] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.777326] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.777326] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-390cb592-453e-4228-83b2-b1b29ea598c8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.777326] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-390cb592-453e-4228-83b2-b1b29ea598c8 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.777326] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-390cb592-453e-4228-83b2-b1b29ea598c8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.777326] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-390cb592-453e-4228-83b2-b1b29ea598c8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.777326] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-390cb592-453e-4228-83b2-b1b29ea598c8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.777326] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.777326] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.778143] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.778143] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.778143] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.778143] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-390cb592-453e-4228-83b2-b1b29ea598c8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.778143] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('390cb592-453e-4228-83b2-b1b29ea598c8',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.279086] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 390cb592-453e-4228-83b2-b1b29ea598c8: rpc.has_security_group_logging(os_id): False [ 813.299434] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.299579] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.299579] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.299850] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.299976] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.300127] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.300268] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.300268] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.300504] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.300504] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.300704] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.300800] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.300866] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.300996] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.301083] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.301297] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.301455] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.301547] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.301718] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.301805] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.301907] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 390cb592-453e-4228-83b2-b1b29ea598c8 is going to be created. [ 813.370793] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.370999] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.370999] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.371263] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.371477] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.384647] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 390cb592-453e-4228-83b2-b1b29ea598c8 in Status: IN_PROGRESS for 2s [ 813.702449] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0a7a78fa-fad0-458c-afc2-e1d98c9176ab in Status: SUCCESS [ 813.702715] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.703083] env[69232]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 813.703174] env[69232]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 814.575260] env[69232]: INFO networking_nsxv3.common.synchronization [None req-5892a01d-6c11-4878-905c-a0b6359b280c None None] Enqueued Resource ID: 0529809b-f12f-4a9f-a84b-91efe08276db with Priority: HIGHEST for action port [ 814.575574] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0529809b-f12f-4a9f-a84b-91efe08276db with Priority: HIGHEST for action port [ 814.576101] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-0529809b-f12f-4a9f-a84b-91efe08276db taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.576407] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0529809b-f12f-4a9f-a84b-91efe08276db" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.576407] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0529809b-f12f-4a9f-a84b-91efe08276db" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.576555] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0529809b-f12f-4a9f-a84b-91efe08276db" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.576642] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0529809b-f12f-4a9f-a84b-91efe08276db',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.882676] env[69232]: INFO networking_nsxv3.common.synchronization [req-2cd5105b-944b-47ff-b65f-e9db46ac0fb1 req-92a08be6-8a75-4f2a-bda3-e5863585ca4a tempest-ServerDiskConfigTestJSON-1562148127 tempest-ServerDiskConfigTestJSON-1562148127-project-member] Enqueued Resource ID: 5a45a455-673b-417d-b2f6-be9352c2077e with Priority: HIGHEST for action security_group_members [ 814.883229] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a45a455-673b-417d-b2f6-be9352c2077e with Priority: HIGHEST for action security_group_members [ 814.883528] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a45a455-673b-417d-b2f6-be9352c2077e taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.883658] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a45a455-673b-417d-b2f6-be9352c2077e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.884331] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a45a455-673b-417d-b2f6-be9352c2077e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.884566] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a45a455-673b-417d-b2f6-be9352c2077e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.884770] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.884882] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.884946] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.885126] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.885211] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.885311] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5a45a455-673b-417d-b2f6-be9352c2077e',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.079446] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0529809b-f12f-4a9f-a84b-91efe08276db [ 815.080168] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.080168] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.080168] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.080614] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.080614] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.080614] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0529809b-f12f-4a9f-a84b-91efe08276db already deleted. [ 815.080746] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0529809b-f12f-4a9f-a84b-91efe08276db" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.390116] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.390336] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.390497] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.390820] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.391550] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.391550] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.391550] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.391550] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.391806] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.391845] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.392023] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5a45a455-673b-417d-b2f6-be9352c2077e is going to be updated. [ 815.409895] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 390cb592-453e-4228-83b2-b1b29ea598c8 in Status: SUCCESS [ 815.409895] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-390cb592-453e-4228-83b2-b1b29ea598c8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.422011] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.422176] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.422254] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.422463] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.422601] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.432732] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a45a455-673b-417d-b2f6-be9352c2077e in Status: IN_PROGRESS for 2s [ 815.446950] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock network-846 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.447195] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "network-846" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.447323] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "network-846" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.447593] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "network-846" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.447859] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.451171] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.451171] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.451171] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.451171] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.451171] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 815.451171] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] NeedRegenerationException {{(pid=69232) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 815.451171] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] no value, waiting for create lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 815.451171] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] value creation lock acquired {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 815.451171] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 815.451171] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Calling creation function for not-yet-present value {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 815.451531] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 815.474167] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 815.474360] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69232) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 815.474509] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Released creation lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 815.474691] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "network-846" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.475016] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock port-b016c91f-1bd9-4c85-8865-2d76406caac7 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.477501] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "port-b016c91f-1bd9-4c85-8865-2d76406caac7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.477726] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "port-b016c91f-1bd9-4c85-8865-2d76406caac7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.478118] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "port-b016c91f-1bd9-4c85-8865-2d76406caac7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.478265] env[69232]: DEBUG networking_nsxv3.api.rpc [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b016c91f-1bd9-4c85-8865-2d76406caac7',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.485585] env[69232]: INFO networking_nsxv3.common.synchronization [None req-4507fe46-dbfe-4d3e-8b79-eaadc774ce57 tempest-ServersV294TestFqdnHostnames-617930467 tempest-ServersV294TestFqdnHostnames-617930467-project-member] Enqueued Resource ID: 345ff80e-1d3c-4ccc-95f9-bc828bfd5095 with Priority: HIGHEST for action security_group_rules [ 815.486410] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 345ff80e-1d3c-4ccc-95f9-bc828bfd5095 with Priority: HIGHEST for action security_group_rules [ 815.486540] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-345ff80e-1d3c-4ccc-95f9-bc828bfd5095 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.486721] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-345ff80e-1d3c-4ccc-95f9-bc828bfd5095" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.487152] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-345ff80e-1d3c-4ccc-95f9-bc828bfd5095" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.488486] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-345ff80e-1d3c-4ccc-95f9-bc828bfd5095" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.489200] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('345ff80e-1d3c-4ccc-95f9-bc828bfd5095',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.639249] env[69232]: INFO networking_nsxv3.common.synchronization [None req-1d24b070-0fd1-4690-92c9-27b4a981a70d tempest-ServersV294TestFqdnHostnames-617930467 tempest-ServersV294TestFqdnHostnames-617930467-project-member] Enqueued Resource ID: 345ff80e-1d3c-4ccc-95f9-bc828bfd5095 with Priority: HIGHEST for action security_group_rules [ 815.639249] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 345ff80e-1d3c-4ccc-95f9-bc828bfd5095 with Priority: HIGHEST for action security_group_rules [ 815.639249] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-345ff80e-1d3c-4ccc-95f9-bc828bfd5095 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.639249] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-345ff80e-1d3c-4ccc-95f9-bc828bfd5095" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.984690] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.984924] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.985060] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.985460] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.985513] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.985663] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Segment Port b016c91f-1bd9-4c85-8865-2d76406caac7 not found, creating... [ 815.985931] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.986101] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.986314] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.986429] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.986565] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.986836] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.986990] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.987163] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.987314] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.987446] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.987678] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Resource: SegmentPort with ID: b016c91f-1bd9-4c85-8865-2d76406caac7 is going to be created. [ 816.009558] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.009734] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.009862] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.010163] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.010388] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.010618] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "port-b016c91f-1bd9-4c85-8865-2d76406caac7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.013859] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.014031] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.014345] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.014425] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.014481] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.014540] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 345ff80e-1d3c-4ccc-95f9-bc828bfd5095 already deleted. [ 816.014625] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-345ff80e-1d3c-4ccc-95f9-bc828bfd5095" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.014793] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-345ff80e-1d3c-4ccc-95f9-bc828bfd5095" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.015078] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-345ff80e-1d3c-4ccc-95f9-bc828bfd5095" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.015161] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('345ff80e-1d3c-4ccc-95f9-bc828bfd5095',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.215283] env[69232]: INFO networking_nsxv3.common.synchronization [req-707da99e-f363-492b-88d1-227da3c462bc req-4317f533-cec8-4cfc-a12b-1d7cf57b79fe tempest-ServersTestJSON-1956507718 tempest-ServersTestJSON-1956507718-project-member] Enqueued Resource ID: 21513cb2-4b6e-4c9f-864c-d3d144ce0d57 with Priority: HIGHEST for action security_group_members [ 816.215855] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21513cb2-4b6e-4c9f-864c-d3d144ce0d57 with Priority: HIGHEST for action security_group_members [ 816.216284] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-21513cb2-4b6e-4c9f-864c-d3d144ce0d57 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.216460] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21513cb2-4b6e-4c9f-864c-d3d144ce0d57" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.216460] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21513cb2-4b6e-4c9f-864c-d3d144ce0d57" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.216696] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21513cb2-4b6e-4c9f-864c-d3d144ce0d57" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.216779] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.216883] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.216883] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.217045] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.217121] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.217222] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('21513cb2-4b6e-4c9f-864c-d3d144ce0d57',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.543864] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.543864] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.543864] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.543864] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.543864] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.543864] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 345ff80e-1d3c-4ccc-95f9-bc828bfd5095 already deleted. [ 816.544518] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-345ff80e-1d3c-4ccc-95f9-bc828bfd5095" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.719719] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.719997] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.719997] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.720191] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.720284] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.720576] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.720675] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.720763] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.721062] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.721062] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.721189] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 21513cb2-4b6e-4c9f-864c-d3d144ce0d57 is going to be updated. [ 816.760076] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.760076] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.760076] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.760076] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.760076] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.767626] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 21513cb2-4b6e-4c9f-864c-d3d144ce0d57 in Status: IN_PROGRESS for 2s [ 816.998590] env[69232]: INFO networking_nsxv3.common.synchronization [req-2cd5105b-944b-47ff-b65f-e9db46ac0fb1 req-62d712a5-01c2-4d28-bd75-2171561688a2 service nova] Enqueued Resource ID: 5a45a455-673b-417d-b2f6-be9352c2077e with Priority: HIGHEST for action security_group_rules [ 816.998772] env[69232]: INFO networking_nsxv3.common.synchronization [req-2cd5105b-944b-47ff-b65f-e9db46ac0fb1 req-62d712a5-01c2-4d28-bd75-2171561688a2 service nova] Enqueued Resource ID: 5a45a455-673b-417d-b2f6-be9352c2077e with Priority: HIGHEST for action security_group_members [ 816.998905] env[69232]: INFO networking_nsxv3.common.synchronization [req-2cd5105b-944b-47ff-b65f-e9db46ac0fb1 req-62d712a5-01c2-4d28-bd75-2171561688a2 service nova] Enqueued Resource ID: b016c91f-1bd9-4c85-8865-2d76406caac7 with Priority: HIGHEST for action port [ 816.999161] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a45a455-673b-417d-b2f6-be9352c2077e with Priority: HIGHEST for action security_group_rules [ 816.999290] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a45a455-673b-417d-b2f6-be9352c2077e with Priority: HIGHEST for action security_group_members [ 816.999408] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b016c91f-1bd9-4c85-8865-2d76406caac7 with Priority: HIGHEST for action port [ 816.999962] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5a45a455-673b-417d-b2f6-be9352c2077e taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.001089] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5a45a455-673b-417d-b2f6-be9352c2077e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.001303] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5a45a455-673b-417d-b2f6-be9352c2077e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.002672] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5a45a455-673b-417d-b2f6-be9352c2077e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.002792] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5a45a455-673b-417d-b2f6-be9352c2077e',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.004231] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a45a455-673b-417d-b2f6-be9352c2077e taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.004332] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a45a455-673b-417d-b2f6-be9352c2077e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.004577] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-b016c91f-1bd9-4c85-8865-2d76406caac7 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.004807] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b016c91f-1bd9-4c85-8865-2d76406caac7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.004807] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b016c91f-1bd9-4c85-8865-2d76406caac7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.004958] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b016c91f-1bd9-4c85-8865-2d76406caac7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.004994] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b016c91f-1bd9-4c85-8865-2d76406caac7',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.446397] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a45a455-673b-417d-b2f6-be9352c2077e in Status: SUCCESS [ 817.446397] env[69232]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5a45a455-673b-417d-b2f6-be9352c2077e deletion is rescheduled due to dependency. [ 817.446397] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a45a455-673b-417d-b2f6-be9352c2077e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.446397] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a45a455-673b-417d-b2f6-be9352c2077e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.446397] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a45a455-673b-417d-b2f6-be9352c2077e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.446397] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.446397] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.448391] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.448849] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.449032] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.449190] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5a45a455-673b-417d-b2f6-be9352c2077e',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.507175] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a45a455-673b-417d-b2f6-be9352c2077e taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.507325] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a45a455-673b-417d-b2f6-be9352c2077e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.507530] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b016c91f-1bd9-4c85-8865-2d76406caac7 with status ACTIVE [ 817.507725] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.507840] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.507897] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.508177] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.508283] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.508583] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.508723] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.508792] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.509130] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.509130] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.509418] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.509501] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.509606] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.509789] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.510177] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.510177] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b016c91f-1bd9-4c85-8865-2d76406caac7 is going to be updated. [ 817.535461] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.535461] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.535461] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.535461] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.535833] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.535833] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b016c91f-1bd9-4c85-8865-2d76406caac7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.652544] env[69232]: INFO networking_nsxv3.common.synchronization [None req-fefa6774-644f-4066-850d-f4fee4cf6745 None None] Enqueued Resource ID: 557cbf74-a174-46c0-8635-40aba5d19706 with Priority: HIGHEST for action port [ 817.652788] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 557cbf74-a174-46c0-8635-40aba5d19706 with Priority: HIGHEST for action port [ 817.653403] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-557cbf74-a174-46c0-8635-40aba5d19706 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.653536] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-557cbf74-a174-46c0-8635-40aba5d19706" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.653607] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-557cbf74-a174-46c0-8635-40aba5d19706" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.653856] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-557cbf74-a174-46c0-8635-40aba5d19706" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.653938] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('557cbf74-a174-46c0-8635-40aba5d19706',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.951837] env[69232]: INFO networking_nsxv3.common.synchronization [req-64b96393-3ce1-4300-85d7-634b2a3b51f6 req-2b583d0b-c2b1-42f1-ae11-95820a90d0e7 tempest-AttachVolumeShelveTestJSON-303748050 tempest-AttachVolumeShelveTestJSON-303748050-project-member] Enqueued Resource ID: 9ea0b8f1-7dc8-48fd-bd49-a3ae8c7a9645 with Priority: HIGHEST for action security_group_members [ 817.952365] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ea0b8f1-7dc8-48fd-bd49-a3ae8c7a9645 with Priority: HIGHEST for action security_group_members [ 817.953057] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ea0b8f1-7dc8-48fd-bd49-a3ae8c7a9645 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.953057] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ea0b8f1-7dc8-48fd-bd49-a3ae8c7a9645" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.953057] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ea0b8f1-7dc8-48fd-bd49-a3ae8c7a9645" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.954173] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ea0b8f1-7dc8-48fd-bd49-a3ae8c7a9645" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.954359] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.954471] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.954543] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.954705] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.954797] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.955056] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9ea0b8f1-7dc8-48fd-bd49-a3ae8c7a9645',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.956128] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5a45a455-673b-417d-b2f6-be9352c2077e',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.155863] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 557cbf74-a174-46c0-8635-40aba5d19706 [ 818.156115] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.159989] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.160165] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.160402] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.160517] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.160628] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:557cbf74-a174-46c0-8635-40aba5d19706 already deleted. [ 818.160714] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-557cbf74-a174-46c0-8635-40aba5d19706" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.458255] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5a45a455-673b-417d-b2f6-be9352c2077e',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.459397] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.459553] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.459619] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.460178] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.460178] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.460178] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.460178] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.460505] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.460505] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.460505] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.460628] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9ea0b8f1-7dc8-48fd-bd49-a3ae8c7a9645 already deleted. [ 818.460628] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ea0b8f1-7dc8-48fd-bd49-a3ae8c7a9645" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.563451] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock network-548 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.563700] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "network-548" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.563780] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "network-548" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.564381] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "network-548" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.564678] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.564843] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.564961] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.565218] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.565421] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.565569] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 818.565686] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] NeedRegenerationException {{(pid=69232) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 818.565795] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] no value, waiting for create lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 818.565904] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] value creation lock acquired {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 818.566039] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 818.566124] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Calling creation function for not-yet-present value {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 818.566261] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 818.589133] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 818.589328] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69232) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 818.589485] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Released creation lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 818.589697] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "network-548" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.590101] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock port-ae4c1fa9-c369-45dc-8281-0eb74346b044 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.590343] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "port-ae4c1fa9-c369-45dc-8281-0eb74346b044" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.590389] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "port-ae4c1fa9-c369-45dc-8281-0eb74346b044" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.590820] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "port-ae4c1fa9-c369-45dc-8281-0eb74346b044" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.590901] env[69232]: DEBUG networking_nsxv3.api.rpc [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ae4c1fa9-c369-45dc-8281-0eb74346b044',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.781564] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 21513cb2-4b6e-4c9f-864c-d3d144ce0d57 in Status: SUCCESS [ 818.781810] env[69232]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 21513cb2-4b6e-4c9f-864c-d3d144ce0d57 deletion is rescheduled due to dependency. [ 818.781958] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21513cb2-4b6e-4c9f-864c-d3d144ce0d57" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.967202] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.967624] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.967624] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.967624] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.967849] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.967849] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5a45a455-673b-417d-b2f6-be9352c2077e is going to be updated. [ 819.003198] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.003402] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.003402] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.003621] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.003767] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.014097] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a45a455-673b-417d-b2f6-be9352c2077e in Status: IN_PROGRESS for 2s [ 819.097079] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.097079] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.097079] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.097079] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.097079] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.097079] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Segment Port ae4c1fa9-c369-45dc-8281-0eb74346b044 not found, creating... [ 819.097079] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.097079] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.097079] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.097079] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.097079] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.097744] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.097744] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.097744] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.097744] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.097744] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.098301] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Resource: SegmentPort with ID: ae4c1fa9-c369-45dc-8281-0eb74346b044 is going to be created. [ 819.120963] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.123601] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.124031] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.124438] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.124809] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.125616] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "port-ae4c1fa9-c369-45dc-8281-0eb74346b044" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.995671] env[69232]: INFO networking_nsxv3.common.synchronization [req-64b96393-3ce1-4300-85d7-634b2a3b51f6 req-2cc477ac-9cce-473a-a08e-67829f700c19 service nova] Enqueued Resource ID: 9ea0b8f1-7dc8-48fd-bd49-a3ae8c7a9645 with Priority: HIGHEST for action security_group_rules [ 819.995671] env[69232]: INFO networking_nsxv3.common.synchronization [req-64b96393-3ce1-4300-85d7-634b2a3b51f6 req-2cc477ac-9cce-473a-a08e-67829f700c19 service nova] Enqueued Resource ID: 9ea0b8f1-7dc8-48fd-bd49-a3ae8c7a9645 with Priority: HIGHEST for action security_group_members [ 819.995671] env[69232]: INFO networking_nsxv3.common.synchronization [req-64b96393-3ce1-4300-85d7-634b2a3b51f6 req-2cc477ac-9cce-473a-a08e-67829f700c19 service nova] Enqueued Resource ID: ae4c1fa9-c369-45dc-8281-0eb74346b044 with Priority: HIGHEST for action port [ 819.995671] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ea0b8f1-7dc8-48fd-bd49-a3ae8c7a9645 with Priority: HIGHEST for action security_group_rules [ 819.995671] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ea0b8f1-7dc8-48fd-bd49-a3ae8c7a9645 with Priority: HIGHEST for action security_group_members [ 819.995671] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae4c1fa9-c369-45dc-8281-0eb74346b044 with Priority: HIGHEST for action port [ 819.995671] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9ea0b8f1-7dc8-48fd-bd49-a3ae8c7a9645 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.000950] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9ea0b8f1-7dc8-48fd-bd49-a3ae8c7a9645" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.000950] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9ea0b8f1-7dc8-48fd-bd49-a3ae8c7a9645" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.000950] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9ea0b8f1-7dc8-48fd-bd49-a3ae8c7a9645" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.000950] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9ea0b8f1-7dc8-48fd-bd49-a3ae8c7a9645',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.000950] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ea0b8f1-7dc8-48fd-bd49-a3ae8c7a9645 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.000950] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ea0b8f1-7dc8-48fd-bd49-a3ae8c7a9645" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.000950] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ea0b8f1-7dc8-48fd-bd49-a3ae8c7a9645" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.000950] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ea0b8f1-7dc8-48fd-bd49-a3ae8c7a9645" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.000950] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.000950] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.000950] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.000950] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.000950] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.000950] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9ea0b8f1-7dc8-48fd-bd49-a3ae8c7a9645',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.006209] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-ae4c1fa9-c369-45dc-8281-0eb74346b044 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.006539] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ae4c1fa9-c369-45dc-8281-0eb74346b044" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.006539] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ae4c1fa9-c369-45dc-8281-0eb74346b044" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.006858] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ae4c1fa9-c369-45dc-8281-0eb74346b044" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.006952] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ae4c1fa9-c369-45dc-8281-0eb74346b044',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.510860] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ea0b8f1-7dc8-48fd-bd49-a3ae8c7a9645 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.511140] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ea0b8f1-7dc8-48fd-bd49-a3ae8c7a9645" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.511314] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9ea0b8f1-7dc8-48fd-bd49-a3ae8c7a9645',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.512234] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ae4c1fa9-c369-45dc-8281-0eb74346b044 with status ACTIVE [ 820.512427] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.512537] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.512607] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.512816] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.512904] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.513098] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.513215] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.513344] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.513421] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.513464] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.513622] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.513714] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.513773] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.513911] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.513982] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.515070] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ae4c1fa9-c369-45dc-8281-0eb74346b044 is going to be updated. [ 820.543047] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.543225] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.543280] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.543491] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.543646] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.545030] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ae4c1fa9-c369-45dc-8281-0eb74346b044" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.828444] env[69232]: INFO networking_nsxv3.common.synchronization [req-e3ccc188-51f6-4b38-8fce-5eec85f9cb42 req-80f1c796-b933-4694-8c6a-b0833a7d12c1 tempest-ServersWithSpecificFlavorTestJSON-338716906 tempest-ServersWithSpecificFlavorTestJSON-338716906-project-member] Enqueued Resource ID: 06438b8f-6cee-4263-9d4c-43067bbe0a4c with Priority: HIGHEST for action security_group_members [ 820.828444] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06438b8f-6cee-4263-9d4c-43067bbe0a4c with Priority: HIGHEST for action security_group_members [ 820.828444] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-06438b8f-6cee-4263-9d4c-43067bbe0a4c taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.828444] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06438b8f-6cee-4263-9d4c-43067bbe0a4c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.828444] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06438b8f-6cee-4263-9d4c-43067bbe0a4c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.828444] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06438b8f-6cee-4263-9d4c-43067bbe0a4c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.828444] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.828444] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.828444] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.828444] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.828444] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.828444] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06438b8f-6cee-4263-9d4c-43067bbe0a4c',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.834220] env[69232]: INFO networking_nsxv3.common.synchronization [req-c6727b0a-b510-4e30-bd46-2eebf4657930 req-dc895277-70de-4019-8a83-b051d8c94027 tempest-ServersTestJSON-524901877 tempest-ServersTestJSON-524901877-project-member] Enqueued Resource ID: bdcc7a21-dd0d-4296-ac34-a880ea6123e7 with Priority: HIGHEST for action security_group_members [ 820.834777] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdcc7a21-dd0d-4296-ac34-a880ea6123e7 with Priority: HIGHEST for action security_group_members [ 820.835087] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.835213] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.835282] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.835594] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.835784] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.835892] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.835956] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.836132] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.836218] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.836312] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bdcc7a21-dd0d-4296-ac34-a880ea6123e7',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.019739] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9ea0b8f1-7dc8-48fd-bd49-a3ae8c7a9645',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.033612] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a45a455-673b-417d-b2f6-be9352c2077e in Status: SUCCESS [ 821.034346] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a45a455-673b-417d-b2f6-be9352c2077e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.034422] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a45a455-673b-417d-b2f6-be9352c2077e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.034623] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a45a455-673b-417d-b2f6-be9352c2077e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.034872] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.034989] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.037156] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.037156] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.037156] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.037156] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a45a455-673b-417d-b2f6-be9352c2077e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.037156] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5a45a455-673b-417d-b2f6-be9352c2077e',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.332970] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.333230] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.333230] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.333469] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.333586] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.333811] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.333966] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.334025] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.334158] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.334252] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.334343] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06438b8f-6cee-4263-9d4c-43067bbe0a4c is going to be updated. [ 821.339098] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.339098] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.339098] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.339098] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.339455] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.339455] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.342607] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.342607] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.342607] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.342607] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.342607] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bdcc7a21-dd0d-4296-ac34-a880ea6123e7 already deleted. [ 821.342607] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.366150] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.366322] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.367230] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.367230] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.367230] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.382492] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06438b8f-6cee-4263-9d4c-43067bbe0a4c in Status: IN_PROGRESS for 2s [ 821.450432] env[69232]: INFO networking_nsxv3.common.synchronization [req-bd81a2d3-2483-41fa-8398-167daefba02c req-5104fe5d-10d1-4960-b516-0412c362b9d3 tempest-VolumesAdminNegativeTest-609403025 tempest-VolumesAdminNegativeTest-609403025-project-member] Enqueued Resource ID: 390cb592-453e-4228-83b2-b1b29ea598c8 with Priority: HIGHEST for action security_group_members [ 821.451225] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 390cb592-453e-4228-83b2-b1b29ea598c8 with Priority: HIGHEST for action security_group_members [ 821.451633] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-390cb592-453e-4228-83b2-b1b29ea598c8 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.451756] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-390cb592-453e-4228-83b2-b1b29ea598c8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.451822] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-390cb592-453e-4228-83b2-b1b29ea598c8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.452178] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-390cb592-453e-4228-83b2-b1b29ea598c8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.452375] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.452514] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.452605] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.452814] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.453199] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.453199] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('390cb592-453e-4228-83b2-b1b29ea598c8',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.526226] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.526444] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.526444] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.526666] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.526761] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.526848] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9ea0b8f1-7dc8-48fd-bd49-a3ae8c7a9645 is going to be created. [ 821.537516] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a45a455-673b-417d-b2f6-be9352c2077e taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.537754] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a45a455-673b-417d-b2f6-be9352c2077e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.537754] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a45a455-673b-417d-b2f6-be9352c2077e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.538107] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a45a455-673b-417d-b2f6-be9352c2077e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.538228] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.538316] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.538316] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.538608] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.538608] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.538791] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a45a455-673b-417d-b2f6-be9352c2077e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.538791] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a45a455-673b-417d-b2f6-be9352c2077e taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.538922] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a45a455-673b-417d-b2f6-be9352c2077e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.538922] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a45a455-673b-417d-b2f6-be9352c2077e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.539066] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a45a455-673b-417d-b2f6-be9352c2077e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.539208] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.539344] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.539344] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.539485] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.540632] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.540909] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a45a455-673b-417d-b2f6-be9352c2077e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.540909] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5a45a455-673b-417d-b2f6-be9352c2077e',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.559285] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.559444] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.559497] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.559708] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.559867] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.570984] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ea0b8f1-7dc8-48fd-bd49-a3ae8c7a9645 in Status: UNINITIALIZED for 2s [ 821.794798] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock network-738 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.795048] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "network-738" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.795172] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "network-738" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.795505] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "network-738" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.795772] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.795938] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.796081] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.796329] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.796493] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.797221] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 821.797221] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] NeedRegenerationException {{(pid=69232) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 821.797221] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] no value, waiting for create lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 821.797221] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] value creation lock acquired {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 821.797474] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 821.797474] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Calling creation function for not-yet-present value {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 821.797474] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 821.819838] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 821.820048] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69232) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 821.820155] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Released creation lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 821.820368] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "network-738" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.820748] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock port-930554c1-3042-4c3b-8ad8-21a85526aad6 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.820937] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "port-930554c1-3042-4c3b-8ad8-21a85526aad6" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.821076] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "port-930554c1-3042-4c3b-8ad8-21a85526aad6" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.821409] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "port-930554c1-3042-4c3b-8ad8-21a85526aad6" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.821617] env[69232]: DEBUG networking_nsxv3.api.rpc [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('930554c1-3042-4c3b-8ad8-21a85526aad6',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.956237] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.956423] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.956492] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.956676] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.956768] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.956957] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.957067] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.957137] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.957319] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.957370] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.957418] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 390cb592-453e-4228-83b2-b1b29ea598c8 is going to be updated. [ 821.993555] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.993803] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.993803] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.994010] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.995092] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.003656] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 390cb592-453e-4228-83b2-b1b29ea598c8 in Status: IN_PROGRESS for 2s [ 822.043372] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5a45a455-673b-417d-b2f6-be9352c2077e: rpc.has_security_group_logging(os_id): False [ 822.071030] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.071030] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.071030] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.071030] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.071030] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.071030] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.071030] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.071030] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.071030] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.071030] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.071030] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.071030] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.071030] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.071030] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.071030] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.072200] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.072200] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.072200] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.072200] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.072200] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.072200] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5a45a455-673b-417d-b2f6-be9352c2077e is going to be updated. [ 822.137308] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.137503] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.137503] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.137730] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.137876] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.160170] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5a45a455-673b-417d-b2f6-be9352c2077e in Status: IN_PROGRESS for 2s [ 822.325244] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.325487] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.325610] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.326057] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.326210] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.326436] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Segment Port 930554c1-3042-4c3b-8ad8-21a85526aad6 not found, creating... [ 822.326726] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.326896] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.327143] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.327380] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.327489] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.327796] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.327959] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.328226] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.328466] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.328620] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.328753] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Resource: SegmentPort with ID: 930554c1-3042-4c3b-8ad8-21a85526aad6 is going to be created. [ 822.349589] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.349872] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.350018] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.350314] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.350633] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.350898] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "port-930554c1-3042-4c3b-8ad8-21a85526aad6" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.296567] env[69232]: INFO networking_nsxv3.common.synchronization [req-c6727b0a-b510-4e30-bd46-2eebf4657930 req-e2f884bd-7b2a-457f-a263-e9644ee0ec3c service nova] Enqueued Resource ID: bdcc7a21-dd0d-4296-ac34-a880ea6123e7 with Priority: HIGHEST for action security_group_rules [ 823.296854] env[69232]: INFO networking_nsxv3.common.synchronization [req-c6727b0a-b510-4e30-bd46-2eebf4657930 req-e2f884bd-7b2a-457f-a263-e9644ee0ec3c service nova] Enqueued Resource ID: bdcc7a21-dd0d-4296-ac34-a880ea6123e7 with Priority: HIGHEST for action security_group_members [ 823.296918] env[69232]: INFO networking_nsxv3.common.synchronization [req-c6727b0a-b510-4e30-bd46-2eebf4657930 req-e2f884bd-7b2a-457f-a263-e9644ee0ec3c service nova] Enqueued Resource ID: 930554c1-3042-4c3b-8ad8-21a85526aad6 with Priority: HIGHEST for action port [ 823.297157] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdcc7a21-dd0d-4296-ac34-a880ea6123e7 with Priority: HIGHEST for action security_group_rules [ 823.297328] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdcc7a21-dd0d-4296-ac34-a880ea6123e7 with Priority: HIGHEST for action security_group_members [ 823.297366] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 930554c1-3042-4c3b-8ad8-21a85526aad6 with Priority: HIGHEST for action port [ 823.297944] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bdcc7a21-dd0d-4296-ac34-a880ea6123e7 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.300816] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.300905] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.301192] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.301280] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bdcc7a21-dd0d-4296-ac34-a880ea6123e7',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.303269] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.303269] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.303269] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.303269] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.303269] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.303269] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.303269] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.303633] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.303633] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.303633] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bdcc7a21-dd0d-4296-ac34-a880ea6123e7',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.309448] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-930554c1-3042-4c3b-8ad8-21a85526aad6 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.309555] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-930554c1-3042-4c3b-8ad8-21a85526aad6" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.309650] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-930554c1-3042-4c3b-8ad8-21a85526aad6" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.309844] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-930554c1-3042-4c3b-8ad8-21a85526aad6" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.309894] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('930554c1-3042-4c3b-8ad8-21a85526aad6',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.392224] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06438b8f-6cee-4263-9d4c-43067bbe0a4c in Status: SUCCESS [ 823.392467] env[69232]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06438b8f-6cee-4263-9d4c-43067bbe0a4c deletion is rescheduled due to dependency. [ 823.392602] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06438b8f-6cee-4263-9d4c-43067bbe0a4c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.580902] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ea0b8f1-7dc8-48fd-bd49-a3ae8c7a9645 in Status: SUCCESS [ 823.581113] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ea0b8f1-7dc8-48fd-bd49-a3ae8c7a9645" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.581282] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ea0b8f1-7dc8-48fd-bd49-a3ae8c7a9645" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.581484] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ea0b8f1-7dc8-48fd-bd49-a3ae8c7a9645" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.581677] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.581794] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.581856] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.582459] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.582459] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.582459] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ea0b8f1-7dc8-48fd-bd49-a3ae8c7a9645" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.582459] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9ea0b8f1-7dc8-48fd-bd49-a3ae8c7a9645',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.596670] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.596888] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.596949] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.597180] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.597289] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.811473] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bdcc7a21-dd0d-4296-ac34-a880ea6123e7',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.815613] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.815771] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.817083] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 930554c1-3042-4c3b-8ad8-21a85526aad6 with status ACTIVE [ 823.817303] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.817433] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.817499] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.817711] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.817802] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.817976] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.818085] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.818140] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.818294] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.818368] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.818669] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.818811] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.818881] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.819057] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.819163] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.819276] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 930554c1-3042-4c3b-8ad8-21a85526aad6 is going to be updated. [ 823.844693] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.844868] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.844964] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.845873] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.845873] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.846075] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-930554c1-3042-4c3b-8ad8-21a85526aad6" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.013968] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 390cb592-453e-4228-83b2-b1b29ea598c8 in Status: SUCCESS [ 824.014215] env[69232]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 390cb592-453e-4228-83b2-b1b29ea598c8 deletion is rescheduled due to dependency. [ 824.014381] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-390cb592-453e-4228-83b2-b1b29ea598c8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.084489] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9ea0b8f1-7dc8-48fd-bd49-a3ae8c7a9645',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.100235] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.179765] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5a45a455-673b-417d-b2f6-be9352c2077e in Status: SUCCESS [ 824.180101] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5a45a455-673b-417d-b2f6-be9352c2077e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.313417] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bdcc7a21-dd0d-4296-ac34-a880ea6123e7',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.589048] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9ea0b8f1-7dc8-48fd-bd49-a3ae8c7a9645: rpc.has_security_group_logging(os_id): False [ 824.602931] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.608282] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.608282] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.608282] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.608282] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.608282] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.608282] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.608282] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.608282] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.608676] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.608676] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.608676] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9ea0b8f1-7dc8-48fd-bd49-a3ae8c7a9645 is going to be created. [ 824.672306] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.672503] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.672503] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.672752] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.672970] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.684810] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9ea0b8f1-7dc8-48fd-bd49-a3ae8c7a9645 in Status: IN_PROGRESS for 2s [ 824.735651] env[69232]: INFO networking_nsxv3.common.synchronization [req-42ffb1b8-1f53-440c-a38d-7e69e2360ecd req-1e43889b-9200-44c6-be47-9f0ba05ea8ee tempest-InstanceActionsTestJSON-369122008 tempest-InstanceActionsTestJSON-369122008-project-member] Enqueued Resource ID: 774040f6-0f3c-4707-b677-d815b078404c with Priority: HIGHEST for action security_group_members [ 824.736188] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 774040f6-0f3c-4707-b677-d815b078404c with Priority: HIGHEST for action security_group_members [ 824.736507] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-774040f6-0f3c-4707-b677-d815b078404c taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.736631] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-774040f6-0f3c-4707-b677-d815b078404c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.736701] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-774040f6-0f3c-4707-b677-d815b078404c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.737027] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-774040f6-0f3c-4707-b677-d815b078404c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.737673] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.737796] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.737865] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.738053] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.738145] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.738241] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('774040f6-0f3c-4707-b677-d815b078404c',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.817100] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.817290] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.817371] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.818023] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.818023] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.818023] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bdcc7a21-dd0d-4296-ac34-a880ea6123e7 is going to be created. [ 824.843086] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.843270] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.843342] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.843550] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.843712] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.854493] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bdcc7a21-dd0d-4296-ac34-a880ea6123e7 in Status: UNINITIALIZED for 2s [ 825.105289] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 825.105406] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 825.241660] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.241932] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.241932] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.242160] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.242256] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.242493] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.242623] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.242685] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.242862] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.242956] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.243062] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 774040f6-0f3c-4707-b677-d815b078404c already deleted. [ 825.243153] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-774040f6-0f3c-4707-b677-d815b078404c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.342957] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock network-955 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.343475] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "network-955" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.343475] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "network-955" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.343664] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "network-955" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.344433] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.344433] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.344433] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.344755] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.344755] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.344865] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 825.344949] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] NeedRegenerationException {{(pid=69232) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 825.345075] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] no value, waiting for create lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 825.345204] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] value creation lock acquired {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 825.345389] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 825.345500] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Calling creation function for not-yet-present value {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 825.345620] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 825.378382] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 825.379410] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Cache value generated in 0.033 seconds for key(s): 'zone-id' {{(pid=69232) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 825.379410] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Released creation lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 825.379410] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "network-955" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.379920] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock port-dffd482b-f9db-41ef-949f-37bc8d35916a taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.380317] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "port-dffd482b-f9db-41ef-949f-37bc8d35916a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.380735] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "port-dffd482b-f9db-41ef-949f-37bc8d35916a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.381387] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "port-dffd482b-f9db-41ef-949f-37bc8d35916a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.381387] env[69232]: DEBUG networking_nsxv3.api.rpc [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dffd482b-f9db-41ef-949f-37bc8d35916a',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.884695] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.885025] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.885115] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.885443] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.885577] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.885754] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Segment Port dffd482b-f9db-41ef-949f-37bc8d35916a not found, creating... [ 825.886066] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.886236] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.886366] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.886619] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.887148] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.887967] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.888396] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.888625] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.888884] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.889105] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.889840] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Resource: SegmentPort with ID: dffd482b-f9db-41ef-949f-37bc8d35916a is going to be created. [ 825.914081] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.914303] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.914442] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.914740] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.915142] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.915389] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "port-dffd482b-f9db-41ef-949f-37bc8d35916a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.093340] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.093495] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.093495] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.093697] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.104967] env[69232]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 826.106162] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.107139] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 826.138346] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.138527] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.138581] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.139274] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.146034] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.146666] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 826.146830] env[69232]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=69232) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 826.146893] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 826.206751] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.207260] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.208031] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.208031] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.209560] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.209560] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 826.286935] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.286935] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.286935] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.287366] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.287463] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.287676] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 826.355136] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.358300] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.358396] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.358811] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.359101] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.359488] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:38. [ 826.359600] env[69232]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'c518d277-32a1-437b-a0b2-37d4c69436b0', 'f29e46f4-baa2-4512-b89f-bb8fa2c53157', '70f65c0d-8fd1-4807-94b2-0a9403b8c3d4', 'aa535b82-e1cd-4d4a-9994-f97b75b51d5e', '9f5186e6-2d35-4ccf-a8b4-749a0a872128', '256e29a3-9ff8-45a1-805b-591f83c2a8b4', '21513cb2-4b6e-4c9f-864c-d3d144ce0d57', '0a7a78fa-fad0-458c-afc2-e1d98c9176ab', '9863f261-b349-427a-acad-78b2e3cc35a0', 'd0209331-de3e-477d-82f5-64fcd50f25cf', '36cbe3ea-321a-4c5f-b46b-f3297d4ccb49', '59f751d0-35f1-46f2-bae9-2c23df6749c4', '531d0f92-2e98-47df-b32d-d49e1d2f34c1', '45780cba-cd94-4a19-b7a8-aa324fdcb9c5', 'd2391c01-2410-4874-a5a8-6da2d957e88c', '6e7bf0fa-24cf-40f7-ac38-1adabda5207c', '453650db-0c42-4224-8f26-d113b3aaa020', '51567675-5d85-4a23-9a2e-1353be4f6ecc', '04c8afd4-5b6b-40d6-827e-7916015a1e43', '390cb592-453e-4228-83b2-b1b29ea598c8', '4046c2da-b145-4a23-9fac-fd79697872c1', '20ba03af-aba0-4fe6-af1e-ea103067fcbe', '5e155778-3c23-43f6-a632-21f66a4311f8', 'fb3494b9-4ce5-4744-a378-ecbcd5c2bec9', '1eb9f24d-331e-450b-9da0-82652ecba032', 'abd587ac-a2db-4962-b166-638ba1590646', '06438b8f-6cee-4263-9d4c-43067bbe0a4c', '5435d71f-3832-4f11-be57-bef3011dd7b7', 'dcd9f79f-c997-4a2d-83a2-472c849b1794', 'd95c4c9e-2568-4fbb-8231-ae683e08215e', '96a06bfd-a7ad-4644-89c3-3168aa1fdf2e', '9ea0b8f1-7dc8-48fd-bd49-a3ae8c7a9645', '5a45a455-673b-417d-b2f6-be9352c2077e', '131f51ef-2833-4453-914e-c87497d66ff6', 'f75b07e5-04f2-4dc3-80ad-ba8105cb4c82', 'c042e2fd-851d-4970-9cfd-994d6fa3bc3a', '24c49db3-d2db-437b-976f-e83851ddd42c', 'b403d6f4-9cfd-407a-9a3f-9a486dae20dc'} {{(pid=69232) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 826.359720] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 826.382331] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.382563] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.382563] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.382732] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.382821] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.382934] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 826.383014] env[69232]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=69232) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 826.383100] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 826.449136] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.449344] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.449344] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.451228] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.451228] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.451228] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 826.451228] env[69232]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=69232) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 826.451228] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 826.451228] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 826.451228] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/38 resources of Type:Security Group Rules [ 826.451228] env[69232]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c518d277-32a1-437b-a0b2-37d4c69436b0 with Priority: HIGH for action security_group_rules [ 826.451228] env[69232]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f29e46f4-baa2-4512-b89f-bb8fa2c53157 with Priority: HIGH for action security_group_rules [ 826.451228] env[69232]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 70f65c0d-8fd1-4807-94b2-0a9403b8c3d4 with Priority: HIGH for action security_group_rules [ 826.451681] env[69232]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: aa535b82-e1cd-4d4a-9994-f97b75b51d5e with Priority: HIGH for action security_group_rules [ 826.451681] env[69232]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9f5186e6-2d35-4ccf-a8b4-749a0a872128 with Priority: HIGH for action security_group_rules [ 826.451681] env[69232]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 256e29a3-9ff8-45a1-805b-591f83c2a8b4 with Priority: HIGH for action security_group_rules [ 826.451681] env[69232]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 21513cb2-4b6e-4c9f-864c-d3d144ce0d57 with Priority: HIGH for action security_group_rules [ 826.451681] env[69232]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0a7a78fa-fad0-458c-afc2-e1d98c9176ab with Priority: HIGH for action security_group_rules [ 826.451681] env[69232]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9863f261-b349-427a-acad-78b2e3cc35a0 with Priority: HIGH for action security_group_rules [ 826.451681] env[69232]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d0209331-de3e-477d-82f5-64fcd50f25cf with Priority: HIGH for action security_group_rules [ 826.451681] env[69232]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 36cbe3ea-321a-4c5f-b46b-f3297d4ccb49 with Priority: HIGH for action security_group_rules [ 826.451937] env[69232]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 59f751d0-35f1-46f2-bae9-2c23df6749c4 with Priority: HIGH for action security_group_rules [ 826.451937] env[69232]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 531d0f92-2e98-47df-b32d-d49e1d2f34c1 with Priority: HIGH for action security_group_rules [ 826.451937] env[69232]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 45780cba-cd94-4a19-b7a8-aa324fdcb9c5 with Priority: HIGH for action security_group_rules [ 826.451937] env[69232]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d2391c01-2410-4874-a5a8-6da2d957e88c with Priority: HIGH for action security_group_rules [ 826.451937] env[69232]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6e7bf0fa-24cf-40f7-ac38-1adabda5207c with Priority: HIGH for action security_group_rules [ 826.452128] env[69232]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 453650db-0c42-4224-8f26-d113b3aaa020 with Priority: HIGH for action security_group_rules [ 826.452128] env[69232]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 51567675-5d85-4a23-9a2e-1353be4f6ecc with Priority: HIGH for action security_group_rules [ 826.452128] env[69232]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 04c8afd4-5b6b-40d6-827e-7916015a1e43 with Priority: HIGH for action security_group_rules [ 826.452223] env[69232]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 390cb592-453e-4228-83b2-b1b29ea598c8 with Priority: HIGH for action security_group_rules [ 826.452258] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.714513] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9ea0b8f1-7dc8-48fd-bd49-a3ae8c7a9645 in Status: SUCCESS [ 826.714513] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9ea0b8f1-7dc8-48fd-bd49-a3ae8c7a9645" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.862029] env[69232]: INFO networking_nsxv3.common.synchronization [req-42ffb1b8-1f53-440c-a38d-7e69e2360ecd req-3fe2713a-db1f-4e91-9605-344563cabc68 service nova] Enqueued Resource ID: 774040f6-0f3c-4707-b677-d815b078404c with Priority: HIGHEST for action security_group_rules [ 826.862029] env[69232]: INFO networking_nsxv3.common.synchronization [req-42ffb1b8-1f53-440c-a38d-7e69e2360ecd req-3fe2713a-db1f-4e91-9605-344563cabc68 service nova] Enqueued Resource ID: 774040f6-0f3c-4707-b677-d815b078404c with Priority: HIGHEST for action security_group_members [ 826.862029] env[69232]: INFO networking_nsxv3.common.synchronization [req-42ffb1b8-1f53-440c-a38d-7e69e2360ecd req-3fe2713a-db1f-4e91-9605-344563cabc68 service nova] Enqueued Resource ID: dffd482b-f9db-41ef-949f-37bc8d35916a with Priority: HIGHEST for action port [ 826.862029] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 774040f6-0f3c-4707-b677-d815b078404c with Priority: HIGHEST for action security_group_rules [ 826.862029] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 774040f6-0f3c-4707-b677-d815b078404c with Priority: HIGHEST for action security_group_members [ 826.862029] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dffd482b-f9db-41ef-949f-37bc8d35916a with Priority: HIGHEST for action port [ 826.862029] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c518d277-32a1-437b-a0b2-37d4c69436b0 with Priority: HIGH for action security_group_rules [ 826.862029] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70f65c0d-8fd1-4807-94b2-0a9403b8c3d4 with Priority: HIGH for action security_group_rules [ 826.862029] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21513cb2-4b6e-4c9f-864c-d3d144ce0d57 with Priority: HIGH for action security_group_rules [ 826.862029] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2391c01-2410-4874-a5a8-6da2d957e88c with Priority: HIGH for action security_group_rules [ 826.862029] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 390cb592-453e-4228-83b2-b1b29ea598c8 with Priority: HIGH for action security_group_rules [ 826.862029] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04c8afd4-5b6b-40d6-827e-7916015a1e43 with Priority: HIGH for action security_group_rules [ 826.862029] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 51567675-5d85-4a23-9a2e-1353be4f6ecc with Priority: HIGH for action security_group_rules [ 826.862029] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 453650db-0c42-4224-8f26-d113b3aaa020 with Priority: HIGH for action security_group_rules [ 826.862029] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45780cba-cd94-4a19-b7a8-aa324fdcb9c5 with Priority: HIGH for action security_group_rules [ 826.862938] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e7bf0fa-24cf-40f7-ac38-1adabda5207c with Priority: HIGH for action security_group_rules [ 826.863216] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 531d0f92-2e98-47df-b32d-d49e1d2f34c1 with Priority: HIGH for action security_group_rules [ 826.866223] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 59f751d0-35f1-46f2-bae9-2c23df6749c4 with Priority: HIGH for action security_group_rules [ 826.866223] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 36cbe3ea-321a-4c5f-b46b-f3297d4ccb49 with Priority: HIGH for action security_group_rules [ 826.866223] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0209331-de3e-477d-82f5-64fcd50f25cf with Priority: HIGH for action security_group_rules [ 826.866223] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9863f261-b349-427a-acad-78b2e3cc35a0 with Priority: HIGH for action security_group_rules [ 826.866223] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 256e29a3-9ff8-45a1-805b-591f83c2a8b4 with Priority: HIGH for action security_group_rules [ 826.866223] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a7a78fa-fad0-458c-afc2-e1d98c9176ab with Priority: HIGH for action security_group_rules [ 826.866223] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f5186e6-2d35-4ccf-a8b4-749a0a872128 with Priority: HIGH for action security_group_rules [ 826.866223] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f29e46f4-baa2-4512-b89f-bb8fa2c53157 with Priority: HIGH for action security_group_rules [ 826.866223] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa535b82-e1cd-4d4a-9994-f97b75b51d5e with Priority: HIGH for action security_group_rules [ 826.866223] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-774040f6-0f3c-4707-b677-d815b078404c taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.866223] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-774040f6-0f3c-4707-b677-d815b078404c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.866223] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-774040f6-0f3c-4707-b677-d815b078404c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.866223] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-774040f6-0f3c-4707-b677-d815b078404c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.866223] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('774040f6-0f3c-4707-b677-d815b078404c',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.869091] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-774040f6-0f3c-4707-b677-d815b078404c taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.869091] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-774040f6-0f3c-4707-b677-d815b078404c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.869091] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-774040f6-0f3c-4707-b677-d815b078404c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.869091] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-774040f6-0f3c-4707-b677-d815b078404c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.870143] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.870143] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.870143] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.872207] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.872207] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.872207] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('774040f6-0f3c-4707-b677-d815b078404c',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.872207] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-dffd482b-f9db-41ef-949f-37bc8d35916a taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.872207] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dffd482b-f9db-41ef-949f-37bc8d35916a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.872207] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dffd482b-f9db-41ef-949f-37bc8d35916a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.872207] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dffd482b-f9db-41ef-949f-37bc8d35916a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.872207] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dffd482b-f9db-41ef-949f-37bc8d35916a',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.874237] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c518d277-32a1-437b-a0b2-37d4c69436b0 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.876043] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c518d277-32a1-437b-a0b2-37d4c69436b0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.876043] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c518d277-32a1-437b-a0b2-37d4c69436b0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.876043] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c518d277-32a1-437b-a0b2-37d4c69436b0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.876043] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c518d277-32a1-437b-a0b2-37d4c69436b0',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.877773] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-70f65c0d-8fd1-4807-94b2-0a9403b8c3d4 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.877928] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-70f65c0d-8fd1-4807-94b2-0a9403b8c3d4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.878049] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-70f65c0d-8fd1-4807-94b2-0a9403b8c3d4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.878360] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-70f65c0d-8fd1-4807-94b2-0a9403b8c3d4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.878492] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('70f65c0d-8fd1-4807-94b2-0a9403b8c3d4',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.882336] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-21513cb2-4b6e-4c9f-864c-d3d144ce0d57 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.882707] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-21513cb2-4b6e-4c9f-864c-d3d144ce0d57" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.882707] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-21513cb2-4b6e-4c9f-864c-d3d144ce0d57" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.882941] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-21513cb2-4b6e-4c9f-864c-d3d144ce0d57" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.883092] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('21513cb2-4b6e-4c9f-864c-d3d144ce0d57',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.884461] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d2391c01-2410-4874-a5a8-6da2d957e88c taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.884461] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d2391c01-2410-4874-a5a8-6da2d957e88c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.884655] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d2391c01-2410-4874-a5a8-6da2d957e88c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.884907] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d2391c01-2410-4874-a5a8-6da2d957e88c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.884907] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d2391c01-2410-4874-a5a8-6da2d957e88c',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.885998] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-390cb592-453e-4228-83b2-b1b29ea598c8 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.886213] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-390cb592-453e-4228-83b2-b1b29ea598c8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.886646] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-390cb592-453e-4228-83b2-b1b29ea598c8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.886753] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-390cb592-453e-4228-83b2-b1b29ea598c8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.886881] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('390cb592-453e-4228-83b2-b1b29ea598c8',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.888835] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-04c8afd4-5b6b-40d6-827e-7916015a1e43 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.888835] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-04c8afd4-5b6b-40d6-827e-7916015a1e43" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.888835] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-04c8afd4-5b6b-40d6-827e-7916015a1e43" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.888835] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-04c8afd4-5b6b-40d6-827e-7916015a1e43" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.888835] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('04c8afd4-5b6b-40d6-827e-7916015a1e43',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.889955] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-51567675-5d85-4a23-9a2e-1353be4f6ecc taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.890204] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-51567675-5d85-4a23-9a2e-1353be4f6ecc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.890313] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-51567675-5d85-4a23-9a2e-1353be4f6ecc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.890512] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-51567675-5d85-4a23-9a2e-1353be4f6ecc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.890663] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('51567675-5d85-4a23-9a2e-1353be4f6ecc',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.893419] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-453650db-0c42-4224-8f26-d113b3aaa020 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.893568] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-453650db-0c42-4224-8f26-d113b3aaa020" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.893620] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-453650db-0c42-4224-8f26-d113b3aaa020" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.894119] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-453650db-0c42-4224-8f26-d113b3aaa020" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.894119] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('453650db-0c42-4224-8f26-d113b3aaa020',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.894597] env[69232]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 11, greater than warning threshold: 10. There could be a leak. Increasing threshold to: 20 [ 826.895577] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-45780cba-cd94-4a19-b7a8-aa324fdcb9c5 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.895893] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-45780cba-cd94-4a19-b7a8-aa324fdcb9c5" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.896057] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-45780cba-cd94-4a19-b7a8-aa324fdcb9c5" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.896289] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-45780cba-cd94-4a19-b7a8-aa324fdcb9c5" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.896404] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('45780cba-cd94-4a19-b7a8-aa324fdcb9c5',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.898116] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6e7bf0fa-24cf-40f7-ac38-1adabda5207c taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.898302] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6e7bf0fa-24cf-40f7-ac38-1adabda5207c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.898409] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6e7bf0fa-24cf-40f7-ac38-1adabda5207c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.898661] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6e7bf0fa-24cf-40f7-ac38-1adabda5207c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.898790] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6e7bf0fa-24cf-40f7-ac38-1adabda5207c',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.899857] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-531d0f92-2e98-47df-b32d-d49e1d2f34c1 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.900044] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-531d0f92-2e98-47df-b32d-d49e1d2f34c1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.900164] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-531d0f92-2e98-47df-b32d-d49e1d2f34c1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.900372] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-531d0f92-2e98-47df-b32d-d49e1d2f34c1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.900496] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('531d0f92-2e98-47df-b32d-d49e1d2f34c1',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.901519] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-59f751d0-35f1-46f2-bae9-2c23df6749c4 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.901760] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-59f751d0-35f1-46f2-bae9-2c23df6749c4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.901904] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-59f751d0-35f1-46f2-bae9-2c23df6749c4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.902162] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-59f751d0-35f1-46f2-bae9-2c23df6749c4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.902252] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('59f751d0-35f1-46f2-bae9-2c23df6749c4',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.903238] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-36cbe3ea-321a-4c5f-b46b-f3297d4ccb49 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.903371] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-36cbe3ea-321a-4c5f-b46b-f3297d4ccb49" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.903477] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-36cbe3ea-321a-4c5f-b46b-f3297d4ccb49" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.903679] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-36cbe3ea-321a-4c5f-b46b-f3297d4ccb49" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.903760] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('36cbe3ea-321a-4c5f-b46b-f3297d4ccb49',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.905272] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d0209331-de3e-477d-82f5-64fcd50f25cf taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.905899] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d0209331-de3e-477d-82f5-64fcd50f25cf" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.905899] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d0209331-de3e-477d-82f5-64fcd50f25cf" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.905899] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d0209331-de3e-477d-82f5-64fcd50f25cf" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.905899] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d0209331-de3e-477d-82f5-64fcd50f25cf',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.907588] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9863f261-b349-427a-acad-78b2e3cc35a0 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.907719] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9863f261-b349-427a-acad-78b2e3cc35a0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.907816] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9863f261-b349-427a-acad-78b2e3cc35a0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.907976] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9863f261-b349-427a-acad-78b2e3cc35a0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.908133] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9863f261-b349-427a-acad-78b2e3cc35a0',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.909774] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-256e29a3-9ff8-45a1-805b-591f83c2a8b4 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.910358] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-256e29a3-9ff8-45a1-805b-591f83c2a8b4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.910358] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-256e29a3-9ff8-45a1-805b-591f83c2a8b4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.910358] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-256e29a3-9ff8-45a1-805b-591f83c2a8b4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.910358] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('256e29a3-9ff8-45a1-805b-591f83c2a8b4',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.911376] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0a7a78fa-fad0-458c-afc2-e1d98c9176ab taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.911483] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.911594] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.911745] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.912408] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0a7a78fa-fad0-458c-afc2-e1d98c9176ab',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.913057] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9f5186e6-2d35-4ccf-a8b4-749a0a872128 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.913231] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.913343] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.913546] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.913673] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9f5186e6-2d35-4ccf-a8b4-749a0a872128',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.913941] env[69232]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 21, greater than warning threshold: 20. There could be a leak. Increasing threshold to: 40 [ 826.915094] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f29e46f4-baa2-4512-b89f-bb8fa2c53157 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.915267] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f29e46f4-baa2-4512-b89f-bb8fa2c53157" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.915375] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f29e46f4-baa2-4512-b89f-bb8fa2c53157" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.915582] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f29e46f4-baa2-4512-b89f-bb8fa2c53157" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.915706] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f29e46f4-baa2-4512-b89f-bb8fa2c53157',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.916752] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aa535b82-e1cd-4d4a-9994-f97b75b51d5e taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.917056] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aa535b82-e1cd-4d4a-9994-f97b75b51d5e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.917281] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aa535b82-e1cd-4d4a-9994-f97b75b51d5e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.917490] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aa535b82-e1cd-4d4a-9994-f97b75b51d5e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.917759] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aa535b82-e1cd-4d4a-9994-f97b75b51d5e',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.921069] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bdcc7a21-dd0d-4296-ac34-a880ea6123e7 in Status: SUCCESS [ 826.921395] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.922736] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-774040f6-0f3c-4707-b677-d815b078404c taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.922875] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-774040f6-0f3c-4707-b677-d815b078404c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.923369] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('774040f6-0f3c-4707-b677-d815b078404c',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.928495] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.928495] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.928616] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.928730] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.928792] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.929049] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.929175] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.929287] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.929386] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bdcc7a21-dd0d-4296-ac34-a880ea6123e7',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.154322] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.154322] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.154322] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.154322] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.154322] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.154322] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.154322] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.154322] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.154322] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.154322] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.154322] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0a7a78fa-fad0-458c-afc2-e1d98c9176ab',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.197656] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.197826] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.197926] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.198148] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.200055] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.200177] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.202068] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.202240] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.203022] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.203144] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.203810] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.203900] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.204654] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.204752] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.228313] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.228313] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9863f261-b349-427a-acad-78b2e3cc35a0 is going to be deleted. [ 827.228313] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.228313] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.258034] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.258034] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9f5186e6-2d35-4ccf-a8b4-749a0a872128 is going to be deleted. [ 827.259164] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.259379] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.297580] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.297580] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 59f751d0-35f1-46f2-bae9-2c23df6749c4 is going to be deleted. [ 827.298510] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.298734] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.301214] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.301351] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.323843] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.323843] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aa535b82-e1cd-4d4a-9994-f97b75b51d5e is going to be deleted. [ 827.325101] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.325369] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.347044] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.347358] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.356184] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.356527] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d0209331-de3e-477d-82f5-64fcd50f25cf is going to be deleted. [ 827.357461] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.358224] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.377758] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.377893] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.419438] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dffd482b-f9db-41ef-949f-37bc8d35916a with status ACTIVE [ 827.419664] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.419865] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.420446] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.420446] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.420446] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.420717] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.420717] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.420717] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.422475] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.422475] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.422475] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.422475] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.422475] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.422475] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.422475] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.422475] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dffd482b-f9db-41ef-949f-37bc8d35916a is going to be updated. [ 827.424791] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.424983] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 390cb592-453e-4228-83b2-b1b29ea598c8 is going to be deleted. [ 827.426113] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.426350] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.426470] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.426593] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9863f261-b349-427a-acad-78b2e3cc35a0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.427296] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.427544] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.427834] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.427900] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.428587] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.428827] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.429098] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.429168] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-59f751d0-35f1-46f2-bae9-2c23df6749c4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.431635] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('774040f6-0f3c-4707-b677-d815b078404c',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.435833] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.435833] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.435975] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.436128] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.436335] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.436476] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.436534] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.436656] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.436743] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.436866] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.437051] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.437154] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.437211] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.437360] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.437497] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.437588] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.437633] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.437772] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.437862] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.437998] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.438211] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bdcc7a21-dd0d-4296-ac34-a880ea6123e7',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.450788] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.450933] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.451455] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.451455] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.451455] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.451455] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aa535b82-e1cd-4d4a-9994-f97b75b51d5e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.467299] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2391c01-2410-4874-a5a8-6da2d957e88c taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.467480] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2391c01-2410-4874-a5a8-6da2d957e88c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.467533] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2391c01-2410-4874-a5a8-6da2d957e88c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.467718] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2391c01-2410-4874-a5a8-6da2d957e88c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.467886] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.469124] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.469306] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.469580] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.469703] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.469835] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2391c01-2410-4874-a5a8-6da2d957e88c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.470100] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d2391c01-2410-4874-a5a8-6da2d957e88c',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.477797] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-45780cba-cd94-4a19-b7a8-aa324fdcb9c5 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.477985] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45780cba-cd94-4a19-b7a8-aa324fdcb9c5" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.478063] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45780cba-cd94-4a19-b7a8-aa324fdcb9c5" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.478631] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45780cba-cd94-4a19-b7a8-aa324fdcb9c5" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.478631] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.478631] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.478895] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.478895] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.478970] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.479056] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45780cba-cd94-4a19-b7a8-aa324fdcb9c5" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.479166] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('45780cba-cd94-4a19-b7a8-aa324fdcb9c5',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.535092] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.535270] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.535364] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.535614] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.535756] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.535917] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dffd482b-f9db-41ef-949f-37bc8d35916a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.644440] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-c518d277-32a1-437b-a0b2-37d4c69436b0 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.644664] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c518d277-32a1-437b-a0b2-37d4c69436b0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.644664] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c518d277-32a1-437b-a0b2-37d4c69436b0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.644870] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c518d277-32a1-437b-a0b2-37d4c69436b0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.645100] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.645229] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.645288] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.645583] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.645793] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.646016] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c518d277-32a1-437b-a0b2-37d4c69436b0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.646123] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c518d277-32a1-437b-a0b2-37d4c69436b0',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.655289] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-531d0f92-2e98-47df-b32d-d49e1d2f34c1 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.655447] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-531d0f92-2e98-47df-b32d-d49e1d2f34c1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.655530] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-531d0f92-2e98-47df-b32d-d49e1d2f34c1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.655758] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-531d0f92-2e98-47df-b32d-d49e1d2f34c1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.655932] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.656043] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.656220] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.656301] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.656348] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.656438] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-531d0f92-2e98-47df-b32d-d49e1d2f34c1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.656533] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('531d0f92-2e98-47df-b32d-d49e1d2f34c1',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.665472] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-f29e46f4-baa2-4512-b89f-bb8fa2c53157 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.665642] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f29e46f4-baa2-4512-b89f-bb8fa2c53157" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.665693] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f29e46f4-baa2-4512-b89f-bb8fa2c53157" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.665907] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f29e46f4-baa2-4512-b89f-bb8fa2c53157" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.666116] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.666214] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.666278] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.666441] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.666528] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.666614] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f29e46f4-baa2-4512-b89f-bb8fa2c53157" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.666704] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f29e46f4-baa2-4512-b89f-bb8fa2c53157',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.672715] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-256e29a3-9ff8-45a1-805b-591f83c2a8b4 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.672926] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-256e29a3-9ff8-45a1-805b-591f83c2a8b4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.673022] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-256e29a3-9ff8-45a1-805b-591f83c2a8b4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.673279] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-256e29a3-9ff8-45a1-805b-591f83c2a8b4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.673538] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.673590] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.673644] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.673847] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.673948] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.674097] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-256e29a3-9ff8-45a1-805b-591f83c2a8b4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.674204] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('256e29a3-9ff8-45a1-805b-591f83c2a8b4',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.675292] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-453650db-0c42-4224-8f26-d113b3aaa020 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.675421] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-453650db-0c42-4224-8f26-d113b3aaa020" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.675501] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-453650db-0c42-4224-8f26-d113b3aaa020" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.675670] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-453650db-0c42-4224-8f26-d113b3aaa020" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.675866] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.676012] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.676099] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.676275] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.676386] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.676511] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-453650db-0c42-4224-8f26-d113b3aaa020" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.676633] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('453650db-0c42-4224-8f26-d113b3aaa020',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.678458] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.678602] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.678680] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.678840] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.678991] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.679118] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.679180] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.679327] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.679406] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.679489] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.679637] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.679734] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.679801] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.679944] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.680093] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.680202] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.680237] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.680368] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.680463] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.680566] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.680643] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0a7a78fa-fad0-458c-afc2-e1d98c9176ab',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.711347] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.711522] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.711685] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.711945] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.712058] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.712183] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d0209331-de3e-477d-82f5-64fcd50f25cf" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.725877] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.726051] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.726112] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.726314] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.726416] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.726536] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-390cb592-453e-4228-83b2-b1b29ea598c8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.735570] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.735795] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.735795] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.736077] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.739839] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.740028] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.742307] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.742307] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.744518] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.744652] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.748777] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.748929] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.776704] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.776704] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.812960] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.813276] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6e7bf0fa-24cf-40f7-ac38-1adabda5207c is going to be deleted. [ 827.814691] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.815074] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.881032] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.881514] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 36cbe3ea-321a-4c5f-b46b-f3297d4ccb49 is going to be deleted. [ 827.883060] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.883453] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.934447] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.934698] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.934822] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.935167] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.935291] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.936028] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 774040f6-0f3c-4707-b677-d815b078404c is going to be created. [ 827.937758] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.937904] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 70f65c0d-8fd1-4807-94b2-0a9403b8c3d4 is going to be deleted. [ 827.938932] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.939189] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.940711] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bdcc7a21-dd0d-4296-ac34-a880ea6123e7: rpc.has_security_group_logging(os_id): False [ 827.942789] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.942918] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.961428] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.961719] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.972262] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2391c01-2410-4874-a5a8-6da2d957e88c taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.972480] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2391c01-2410-4874-a5a8-6da2d957e88c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.972480] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2391c01-2410-4874-a5a8-6da2d957e88c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.972681] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2391c01-2410-4874-a5a8-6da2d957e88c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.973083] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.973442] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.973442] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.973603] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.973704] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.973823] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2391c01-2410-4874-a5a8-6da2d957e88c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.974060] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2391c01-2410-4874-a5a8-6da2d957e88c taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.974244] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2391c01-2410-4874-a5a8-6da2d957e88c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.974297] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2391c01-2410-4874-a5a8-6da2d957e88c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.974513] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2391c01-2410-4874-a5a8-6da2d957e88c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.974708] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.974833] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.974915] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.975103] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.975194] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.975323] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2391c01-2410-4874-a5a8-6da2d957e88c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.975443] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d2391c01-2410-4874-a5a8-6da2d957e88c',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.982414] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.982618] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 04c8afd4-5b6b-40d6-827e-7916015a1e43 is going to be deleted. [ 827.983847] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('45780cba-cd94-4a19-b7a8-aa324fdcb9c5',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.984844] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.984981] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.003492] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.003691] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.003762] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.003961] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.004180] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.005950] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.006317] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.018999] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 774040f6-0f3c-4707-b677-d815b078404c in Status: UNINITIALIZED for 2s [ 828.022630] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.022802] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 51567675-5d85-4a23-9a2e-1353be4f6ecc is going to be deleted. [ 828.023835] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.023995] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.062086] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.062268] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 21513cb2-4b6e-4c9f-864c-d3d144ce0d57 is going to be deleted. [ 828.063275] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.063553] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.063649] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.067086] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6e7bf0fa-24cf-40f7-ac38-1adabda5207c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.067086] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.067086] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.067086] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.067086] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.067086] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.067086] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.067086] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.067086] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.067086] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.067086] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.067086] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.067086] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.067086] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.067848] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.067848] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.067848] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.067848] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.067848] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.067848] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bdcc7a21-dd0d-4296-ac34-a880ea6123e7 is going to be created. [ 828.067848] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.067848] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.067848] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.068315] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-36cbe3ea-321a-4c5f-b46b-f3297d4ccb49" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.098297] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.098297] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.098297] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.098297] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.098297] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.098297] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-70f65c0d-8fd1-4807-94b2-0a9403b8c3d4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.122295] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.122295] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.122295] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.122295] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.122295] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.122295] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-04c8afd4-5b6b-40d6-827e-7916015a1e43" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.150824] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c518d277-32a1-437b-a0b2-37d4c69436b0',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.154957] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.155340] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.155340] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.155421] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.155515] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.155647] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-51567675-5d85-4a23-9a2e-1353be4f6ecc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.159497] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-531d0f92-2e98-47df-b32d-d49e1d2f34c1 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.159613] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-531d0f92-2e98-47df-b32d-d49e1d2f34c1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.159656] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-531d0f92-2e98-47df-b32d-d49e1d2f34c1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.159864] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-531d0f92-2e98-47df-b32d-d49e1d2f34c1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.160047] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.160150] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.160211] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.160453] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.160453] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.160588] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-531d0f92-2e98-47df-b32d-d49e1d2f34c1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.160682] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-531d0f92-2e98-47df-b32d-d49e1d2f34c1 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.160776] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-531d0f92-2e98-47df-b32d-d49e1d2f34c1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.160829] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-531d0f92-2e98-47df-b32d-d49e1d2f34c1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.160970] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-531d0f92-2e98-47df-b32d-d49e1d2f34c1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.161140] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.161232] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.161293] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.161444] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.161487] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.161588] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-531d0f92-2e98-47df-b32d-d49e1d2f34c1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.161688] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('531d0f92-2e98-47df-b32d-d49e1d2f34c1',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.179510] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f29e46f4-baa2-4512-b89f-bb8fa2c53157',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.186731] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-256e29a3-9ff8-45a1-805b-591f83c2a8b4 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.186926] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-256e29a3-9ff8-45a1-805b-591f83c2a8b4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.186986] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-256e29a3-9ff8-45a1-805b-591f83c2a8b4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.187225] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-256e29a3-9ff8-45a1-805b-591f83c2a8b4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.187396] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.187497] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.187600] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.187759] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.187858] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.187971] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-256e29a3-9ff8-45a1-805b-591f83c2a8b4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.188097] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-256e29a3-9ff8-45a1-805b-591f83c2a8b4 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.188181] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-256e29a3-9ff8-45a1-805b-591f83c2a8b4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.188239] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-256e29a3-9ff8-45a1-805b-591f83c2a8b4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.188379] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-256e29a3-9ff8-45a1-805b-591f83c2a8b4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.188641] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.188641] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.188766] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.188836] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.188909] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.188986] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-256e29a3-9ff8-45a1-805b-591f83c2a8b4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.189633] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('256e29a3-9ff8-45a1-805b-591f83c2a8b4',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.190362] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0a7a78fa-fad0-458c-afc2-e1d98c9176ab: rpc.has_security_group_logging(os_id): False [ 828.193847] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('453650db-0c42-4224-8f26-d113b3aaa020',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.197403] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.197565] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.197565] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.197893] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.197893] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.197964] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-21513cb2-4b6e-4c9f-864c-d3d144ce0d57" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.239503] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.239697] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.239773] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.240025] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.274033] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.274033] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.288784] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.289252] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.289828] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.289828] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.289899] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.290026] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.291686] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.291849] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.291911] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.292444] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.292582] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.292777] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.292874] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.292986] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.293132] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.293213] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.293304] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0a7a78fa-fad0-458c-afc2-e1d98c9176ab is going to be updated. [ 828.294452] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.294632] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.294806] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.308802] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bdcc7a21-dd0d-4296-ac34-a880ea6123e7 in Status: IN_PROGRESS for 2s [ 828.384577] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.384981] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.384981] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.385070] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.385219] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.401511] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0a7a78fa-fad0-458c-afc2-e1d98c9176ab in Status: IN_PROGRESS for 2s [ 828.479040] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d2391c01-2410-4874-a5a8-6da2d957e88c: rpc.has_security_group_logging(os_id): False [ 828.488058] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 45780cba-cd94-4a19-b7a8-aa324fdcb9c5: rpc.has_security_group_logging(os_id): False [ 828.499209] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.499920] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.499920] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.499920] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.514144] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.514337] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.523039] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.524779] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.524779] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.524779] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.524779] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.524779] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.524779] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.524779] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.524779] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.524779] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.524779] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.524779] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.524779] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.525621] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.525621] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.525621] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.525621] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d2391c01-2410-4874-a5a8-6da2d957e88c is going to be updated. [ 828.526490] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.526722] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.549179] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.549620] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.549826] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.549826] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.550033] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.550126] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.550221] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 45780cba-cd94-4a19-b7a8-aa324fdcb9c5 is going to be updated. [ 828.604424] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.604628] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.604745] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.605068] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.605223] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.624133] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d2391c01-2410-4874-a5a8-6da2d957e88c in Status: IN_PROGRESS for 2s [ 828.633048] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.633048] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.633048] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.633048] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.633048] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.654235] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c518d277-32a1-437b-a0b2-37d4c69436b0: rpc.has_security_group_logging(os_id): False [ 828.658819] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 45780cba-cd94-4a19-b7a8-aa324fdcb9c5 in Status: IN_PROGRESS for 2s [ 828.669251] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 531d0f92-2e98-47df-b32d-d49e1d2f34c1: rpc.has_security_group_logging(os_id): False [ 828.682124] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f29e46f4-baa2-4512-b89f-bb8fa2c53157: rpc.has_security_group_logging(os_id): False [ 828.697560] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 453650db-0c42-4224-8f26-d113b3aaa020: rpc.has_security_group_logging(os_id): False [ 828.697808] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 256e29a3-9ff8-45a1-805b-591f83c2a8b4: rpc.has_security_group_logging(os_id): False [ 828.731446] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.731710] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.731824] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.732116] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.734187] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.734320] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.735108] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.735206] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.735909] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.736016] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.741597] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.741597] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.773210] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.773555] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.773675] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.773943] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.774022] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.774084] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.774194] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c518d277-32a1-437b-a0b2-37d4c69436b0 is going to be updated. [ 828.775346] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.775548] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.817639] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.818718] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.819060] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.819288] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.819719] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.819953] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.820202] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 453650db-0c42-4224-8f26-d113b3aaa020 is going to be updated. [ 828.824209] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.825212] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.857980] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.858344] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.858572] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.858572] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.858778] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.858864] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.858982] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f29e46f4-baa2-4512-b89f-bb8fa2c53157 is going to be updated. [ 828.860363] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.860668] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.864212] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.864361] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.898426] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.899752] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.899752] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.899752] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.899752] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.899752] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.900081] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.900081] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.900081] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.900318] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.900446] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.900751] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.900997] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.900997] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.904030] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.904030] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.904030] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 531d0f92-2e98-47df-b32d-d49e1d2f34c1 is going to be updated. [ 828.904030] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.904030] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.936265] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.936659] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.936882] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.936963] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.937287] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.937377] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.937573] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.937686] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.937728] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.937876] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.937944] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.938432] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.938582] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.938654] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.938826] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.938923] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.938960] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 256e29a3-9ff8-45a1-805b-591f83c2a8b4 is going to be updated. [ 828.941167] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.941167] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.941167] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.966733] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.966934] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.966934] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.967256] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.967647] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.970788] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.970933] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.971778] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.971778] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.971778] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.975122] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c518d277-32a1-437b-a0b2-37d4c69436b0 in Status: IN_PROGRESS for 2s [ 828.982897] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 453650db-0c42-4224-8f26-d113b3aaa020 in Status: IN_PROGRESS for 2s [ 828.989184] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f29e46f4-baa2-4512-b89f-bb8fa2c53157 in Status: IN_PROGRESS for 2s [ 829.047341] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.047524] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.047566] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.047746] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.047890] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.066930] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 531d0f92-2e98-47df-b32d-d49e1d2f34c1 in Status: IN_PROGRESS for 2s [ 829.103963] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.104237] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.104692] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.104692] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.104929] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.136705] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 256e29a3-9ff8-45a1-805b-591f83c2a8b4 in Status: IN_PROGRESS for 2s [ 830.029053] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 774040f6-0f3c-4707-b677-d815b078404c in Status: SUCCESS [ 830.029487] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-774040f6-0f3c-4707-b677-d815b078404c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.029487] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-774040f6-0f3c-4707-b677-d815b078404c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.029682] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-774040f6-0f3c-4707-b677-d815b078404c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.029787] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.029895] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.029956] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.030129] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.030212] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.030292] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-774040f6-0f3c-4707-b677-d815b078404c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.030386] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('774040f6-0f3c-4707-b677-d815b078404c',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.322992] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bdcc7a21-dd0d-4296-ac34-a880ea6123e7 in Status: SUCCESS [ 830.323302] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.418083] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0a7a78fa-fad0-458c-afc2-e1d98c9176ab in Status: SUCCESS [ 830.418300] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.534225] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-774040f6-0f3c-4707-b677-d815b078404c taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.534462] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-774040f6-0f3c-4707-b677-d815b078404c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.534462] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-774040f6-0f3c-4707-b677-d815b078404c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.534622] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-774040f6-0f3c-4707-b677-d815b078404c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.534790] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.534923] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.535055] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.535201] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.535287] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.535377] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-774040f6-0f3c-4707-b677-d815b078404c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.535532] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-774040f6-0f3c-4707-b677-d815b078404c taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.535622] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-774040f6-0f3c-4707-b677-d815b078404c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.535696] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-774040f6-0f3c-4707-b677-d815b078404c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.535841] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-774040f6-0f3c-4707-b677-d815b078404c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.535975] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.536098] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.536152] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.536257] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.536322] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.536403] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-774040f6-0f3c-4707-b677-d815b078404c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.536490] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('774040f6-0f3c-4707-b677-d815b078404c',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.645380] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d2391c01-2410-4874-a5a8-6da2d957e88c in Status: SUCCESS [ 830.645726] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d2391c01-2410-4874-a5a8-6da2d957e88c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.671989] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 45780cba-cd94-4a19-b7a8-aa324fdcb9c5 in Status: SUCCESS [ 830.672239] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-45780cba-cd94-4a19-b7a8-aa324fdcb9c5" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.998309] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c518d277-32a1-437b-a0b2-37d4c69436b0 in Status: SUCCESS [ 830.998573] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c518d277-32a1-437b-a0b2-37d4c69436b0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.999659] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 453650db-0c42-4224-8f26-d113b3aaa020 in Status: SUCCESS [ 830.999659] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-453650db-0c42-4224-8f26-d113b3aaa020" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.007229] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f29e46f4-baa2-4512-b89f-bb8fa2c53157 in Status: SUCCESS [ 831.007229] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f29e46f4-baa2-4512-b89f-bb8fa2c53157" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.039583] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 774040f6-0f3c-4707-b677-d815b078404c: rpc.has_security_group_logging(os_id): False [ 831.060894] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.060894] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.060894] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.060894] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.060894] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.061279] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.061279] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.061279] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.061404] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.061451] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.061630] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.061741] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.064020] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.064020] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.064020] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.064020] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.064020] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.064020] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.064020] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.064020] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.064020] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 774040f6-0f3c-4707-b677-d815b078404c is going to be created. [ 831.080200] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 531d0f92-2e98-47df-b32d-d49e1d2f34c1 in Status: SUCCESS [ 831.080200] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-531d0f92-2e98-47df-b32d-d49e1d2f34c1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.126703] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.126927] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.126927] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.127205] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.127394] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.137600] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 774040f6-0f3c-4707-b677-d815b078404c in Status: IN_PROGRESS for 2s [ 831.150673] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 256e29a3-9ff8-45a1-805b-591f83c2a8b4 in Status: SUCCESS [ 831.151550] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-256e29a3-9ff8-45a1-805b-591f83c2a8b4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.535537] env[69232]: INFO networking_nsxv3.common.synchronization [req-f0b72461-98a4-46ae-b777-f32d5fd2ac40 req-ab120ff1-f831-4ce7-ae50-56f71c95a388 tempest-AttachInterfacesTestJSON-1442903876 tempest-AttachInterfacesTestJSON-1442903876-project-member] Enqueued Resource ID: 4843729c-bd07-48e1-9798-7dc90829718d with Priority: HIGHEST for action security_group_members [ 831.536245] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4843729c-bd07-48e1-9798-7dc90829718d with Priority: HIGHEST for action security_group_members [ 831.536661] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-4843729c-bd07-48e1-9798-7dc90829718d taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.536818] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4843729c-bd07-48e1-9798-7dc90829718d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.536913] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4843729c-bd07-48e1-9798-7dc90829718d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.537215] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4843729c-bd07-48e1-9798-7dc90829718d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.537410] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.537567] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.537747] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.537973] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.538109] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.538236] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4843729c-bd07-48e1-9798-7dc90829718d',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.692162] env[69232]: INFO networking_nsxv3.common.synchronization [req-791f0717-ca2d-47a7-b59a-b5a9f52df9e6 req-d467c4ca-47eb-44df-9dac-da24f8e35aa6 tempest-ImagesTestJSON-1245210724 tempest-ImagesTestJSON-1245210724-project-member] Enqueued Resource ID: fb3494b9-4ce5-4744-a378-ecbcd5c2bec9 with Priority: HIGHEST for action security_group_members [ 831.695327] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb3494b9-4ce5-4744-a378-ecbcd5c2bec9 with Priority: HIGHEST for action security_group_members [ 831.698127] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.698127] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.698127] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.698127] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.698127] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.698127] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.698127] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.699217] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.699368] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.700040] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fb3494b9-4ce5-4744-a378-ecbcd5c2bec9',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.041980] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.042443] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.042443] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.042669] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.042942] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.043288] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.043459] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.043584] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.043854] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.043993] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.044214] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4843729c-bd07-48e1-9798-7dc90829718d already deleted. [ 832.044308] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4843729c-bd07-48e1-9798-7dc90829718d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.204521] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.204673] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.204884] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.205101] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.233267] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.234142] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.234142] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.234142] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.234142] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.234142] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.234428] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb3494b9-4ce5-4744-a378-ecbcd5c2bec9 is going to be updated. [ 832.268570] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.268791] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.268881] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.269147] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.269313] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.279225] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb3494b9-4ce5-4744-a378-ecbcd5c2bec9 in Status: IN_PROGRESS for 2s [ 832.399949] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock network-756 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.400336] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "network-756" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.400494] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "network-756" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.400804] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "network-756" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.401094] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.401259] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.401378] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.401618] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.401778] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.401993] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 832.402122] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] NeedRegenerationException {{(pid=69232) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 832.403441] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] no value, waiting for create lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 832.403646] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] value creation lock acquired {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 832.403769] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 832.403837] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Calling creation function for not-yet-present value {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 832.403973] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 832.429297] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 832.429523] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=69232) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 832.429663] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Released creation lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 832.429870] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "network-756" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.430213] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock port-aa034852-13ba-4222-a761-67ec7d05d1ab taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.430396] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "port-aa034852-13ba-4222-a761-67ec7d05d1ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.430577] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "port-aa034852-13ba-4222-a761-67ec7d05d1ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.430963] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "port-aa034852-13ba-4222-a761-67ec7d05d1ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.431128] env[69232]: DEBUG networking_nsxv3.api.rpc [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aa034852-13ba-4222-a761-67ec7d05d1ab',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.933706] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.934032] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.934108] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.934412] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.934570] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.934730] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Segment Port aa034852-13ba-4222-a761-67ec7d05d1ab not found, creating... [ 832.935047] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.935189] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.935319] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.935583] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.935750] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.936114] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.936286] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.936409] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.936658] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.936798] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.936942] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Resource: SegmentPort with ID: aa034852-13ba-4222-a761-67ec7d05d1ab is going to be created. [ 832.958089] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.958328] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.958468] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.958741] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.958976] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.959227] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "port-aa034852-13ba-4222-a761-67ec7d05d1ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.150297] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 774040f6-0f3c-4707-b677-d815b078404c in Status: SUCCESS [ 833.151887] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-774040f6-0f3c-4707-b677-d815b078404c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.114718] env[69232]: INFO networking_nsxv3.common.synchronization [req-f0b72461-98a4-46ae-b777-f32d5fd2ac40 req-27f3b810-8cb2-455a-a87d-75b2a88df175 service nova] Enqueued Resource ID: 4843729c-bd07-48e1-9798-7dc90829718d with Priority: HIGHEST for action security_group_rules [ 834.114900] env[69232]: INFO networking_nsxv3.common.synchronization [req-f0b72461-98a4-46ae-b777-f32d5fd2ac40 req-27f3b810-8cb2-455a-a87d-75b2a88df175 service nova] Enqueued Resource ID: 4843729c-bd07-48e1-9798-7dc90829718d with Priority: HIGHEST for action security_group_members [ 834.115056] env[69232]: INFO networking_nsxv3.common.synchronization [req-f0b72461-98a4-46ae-b777-f32d5fd2ac40 req-27f3b810-8cb2-455a-a87d-75b2a88df175 service nova] Enqueued Resource ID: aa034852-13ba-4222-a761-67ec7d05d1ab with Priority: HIGHEST for action port [ 834.115292] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4843729c-bd07-48e1-9798-7dc90829718d with Priority: HIGHEST for action security_group_rules [ 834.115426] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4843729c-bd07-48e1-9798-7dc90829718d with Priority: HIGHEST for action security_group_members [ 834.115570] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa034852-13ba-4222-a761-67ec7d05d1ab with Priority: HIGHEST for action port [ 834.120943] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4843729c-bd07-48e1-9798-7dc90829718d taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.121125] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4843729c-bd07-48e1-9798-7dc90829718d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.121189] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4843729c-bd07-48e1-9798-7dc90829718d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.121482] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4843729c-bd07-48e1-9798-7dc90829718d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.121583] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4843729c-bd07-48e1-9798-7dc90829718d',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.122615] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-4843729c-bd07-48e1-9798-7dc90829718d taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.122731] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4843729c-bd07-48e1-9798-7dc90829718d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.122731] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4843729c-bd07-48e1-9798-7dc90829718d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.122908] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4843729c-bd07-48e1-9798-7dc90829718d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.123082] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.123178] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.123241] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.123399] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.123470] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.123564] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4843729c-bd07-48e1-9798-7dc90829718d',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.125107] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-aa034852-13ba-4222-a761-67ec7d05d1ab taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.125107] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aa034852-13ba-4222-a761-67ec7d05d1ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.125107] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aa034852-13ba-4222-a761-67ec7d05d1ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.125107] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aa034852-13ba-4222-a761-67ec7d05d1ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.125312] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aa034852-13ba-4222-a761-67ec7d05d1ab',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.290299] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb3494b9-4ce5-4744-a378-ecbcd5c2bec9 in Status: SUCCESS [ 834.290720] env[69232]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb3494b9-4ce5-4744-a378-ecbcd5c2bec9 deletion is rescheduled due to dependency. [ 834.290720] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.626687] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4843729c-bd07-48e1-9798-7dc90829718d',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.630298] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-4843729c-bd07-48e1-9798-7dc90829718d taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.630298] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4843729c-bd07-48e1-9798-7dc90829718d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.630298] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port aa034852-13ba-4222-a761-67ec7d05d1ab with status ACTIVE [ 834.630537] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.630712] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.630803] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.630967] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.631068] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.631239] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.631336] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.631392] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.631542] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.631625] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.631791] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.631927] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.631927] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.632097] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.632152] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.632205] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: aa034852-13ba-4222-a761-67ec7d05d1ab is going to be updated. [ 834.653348] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.653498] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.653573] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.653745] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.653884] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.654045] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aa034852-13ba-4222-a761-67ec7d05d1ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.130018] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4843729c-bd07-48e1-9798-7dc90829718d',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.635276] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.635276] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.635276] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.635276] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.635276] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.635276] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4843729c-bd07-48e1-9798-7dc90829718d is going to be created. [ 835.661979] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.661979] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.661979] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.661979] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.661979] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.671137] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4843729c-bd07-48e1-9798-7dc90829718d in Status: UNINITIALIZED for 2s [ 837.683055] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4843729c-bd07-48e1-9798-7dc90829718d in Status: SUCCESS [ 837.683346] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4843729c-bd07-48e1-9798-7dc90829718d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.683460] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4843729c-bd07-48e1-9798-7dc90829718d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.683674] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4843729c-bd07-48e1-9798-7dc90829718d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.684173] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.684173] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.684173] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.684486] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.684486] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.684486] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4843729c-bd07-48e1-9798-7dc90829718d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.684486] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4843729c-bd07-48e1-9798-7dc90829718d',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.160017] env[69232]: INFO networking_nsxv3.common.synchronization [req-ba11619c-8154-42be-ad74-e1ba3df9be68 req-c193b8f4-dea0-4d5e-b1cb-b3d1c066ce7c tempest-ImagesNegativeTestJSON-1337708046 tempest-ImagesNegativeTestJSON-1337708046-project-member] Enqueued Resource ID: 415b5ffc-5000-49bb-a961-29bcf6fcb57a with Priority: HIGHEST for action security_group_members [ 838.160017] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 415b5ffc-5000-49bb-a961-29bcf6fcb57a with Priority: HIGHEST for action security_group_members [ 838.160017] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-415b5ffc-5000-49bb-a961-29bcf6fcb57a taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.160017] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-415b5ffc-5000-49bb-a961-29bcf6fcb57a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.160017] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-415b5ffc-5000-49bb-a961-29bcf6fcb57a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.160017] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-415b5ffc-5000-49bb-a961-29bcf6fcb57a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.160017] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.160017] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.160017] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.162412] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.162412] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.162412] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('415b5ffc-5000-49bb-a961-29bcf6fcb57a',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.188495] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4843729c-bd07-48e1-9798-7dc90829718d',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.490973] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock network-922 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.491256] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "network-922" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.491399] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "network-922" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.491747] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "network-922" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.492327] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.492583] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.492765] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.493125] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.493372] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.493823] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 838.493823] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] NeedRegenerationException {{(pid=69232) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 838.493941] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] no value, waiting for create lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 838.494144] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] value creation lock acquired {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 838.494313] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 838.494474] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Calling creation function for not-yet-present value {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 838.494770] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 838.516057] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 838.516321] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69232) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 838.516537] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Released creation lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 838.517026] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "network-922" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.517429] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock port-5c9271bb-855d-4d80-beff-ea23c8e62c91 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.517623] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "port-5c9271bb-855d-4d80-beff-ea23c8e62c91" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.517750] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "port-5c9271bb-855d-4d80-beff-ea23c8e62c91" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.518382] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "port-5c9271bb-855d-4d80-beff-ea23c8e62c91" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.518619] env[69232]: DEBUG networking_nsxv3.api.rpc [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5c9271bb-855d-4d80-beff-ea23c8e62c91',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.664072] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.664256] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.664312] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.664602] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.664730] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.664973] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.665036] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.665100] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.665265] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.665370] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.665417] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 415b5ffc-5000-49bb-a961-29bcf6fcb57a already deleted. [ 838.665471] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-415b5ffc-5000-49bb-a961-29bcf6fcb57a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.695179] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4843729c-bd07-48e1-9798-7dc90829718d: rpc.has_security_group_logging(os_id): False [ 838.714822] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.714999] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.715057] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.715276] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.715370] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.715632] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.715728] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.715776] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.715941] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.716034] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.716123] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4843729c-bd07-48e1-9798-7dc90829718d is going to be created. [ 838.780153] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.780302] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.780368] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.780583] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.780796] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.796054] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4843729c-bd07-48e1-9798-7dc90829718d in Status: IN_PROGRESS for 2s [ 839.022287] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.022501] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.022577] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.023492] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.023492] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.023492] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Segment Port 5c9271bb-855d-4d80-beff-ea23c8e62c91 not found, creating... [ 839.023492] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.023701] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.023751] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.024056] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.024127] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.024426] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.024556] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.024677] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.024890] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.025056] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.025190] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Resource: SegmentPort with ID: 5c9271bb-855d-4d80-beff-ea23c8e62c91 is going to be created. [ 839.050841] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.051127] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.051264] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.053992] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.054486] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.054637] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "port-5c9271bb-855d-4d80-beff-ea23c8e62c91" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.735902] env[69232]: INFO networking_nsxv3.common.synchronization [req-ba11619c-8154-42be-ad74-e1ba3df9be68 req-6d3e5fe1-c597-4799-a97c-3753f1753788 service nova] Enqueued Resource ID: 415b5ffc-5000-49bb-a961-29bcf6fcb57a with Priority: HIGHEST for action security_group_rules [ 839.736258] env[69232]: INFO networking_nsxv3.common.synchronization [req-ba11619c-8154-42be-ad74-e1ba3df9be68 req-6d3e5fe1-c597-4799-a97c-3753f1753788 service nova] Enqueued Resource ID: 415b5ffc-5000-49bb-a961-29bcf6fcb57a with Priority: HIGHEST for action security_group_members [ 839.736258] env[69232]: INFO networking_nsxv3.common.synchronization [req-ba11619c-8154-42be-ad74-e1ba3df9be68 req-6d3e5fe1-c597-4799-a97c-3753f1753788 service nova] Enqueued Resource ID: 5c9271bb-855d-4d80-beff-ea23c8e62c91 with Priority: HIGHEST for action port [ 839.736473] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 415b5ffc-5000-49bb-a961-29bcf6fcb57a with Priority: HIGHEST for action security_group_rules [ 839.736599] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 415b5ffc-5000-49bb-a961-29bcf6fcb57a with Priority: HIGHEST for action security_group_members [ 839.736690] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c9271bb-855d-4d80-beff-ea23c8e62c91 with Priority: HIGHEST for action port [ 839.737414] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-415b5ffc-5000-49bb-a961-29bcf6fcb57a taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.737414] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-415b5ffc-5000-49bb-a961-29bcf6fcb57a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.737414] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-415b5ffc-5000-49bb-a961-29bcf6fcb57a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.737661] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-415b5ffc-5000-49bb-a961-29bcf6fcb57a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.738497] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('415b5ffc-5000-49bb-a961-29bcf6fcb57a',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.738959] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-415b5ffc-5000-49bb-a961-29bcf6fcb57a taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.739086] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-415b5ffc-5000-49bb-a961-29bcf6fcb57a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.739151] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-415b5ffc-5000-49bb-a961-29bcf6fcb57a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.739323] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-415b5ffc-5000-49bb-a961-29bcf6fcb57a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.739469] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.739559] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.739617] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.739759] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.739842] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.739934] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('415b5ffc-5000-49bb-a961-29bcf6fcb57a',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.741779] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-5c9271bb-855d-4d80-beff-ea23c8e62c91 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.741779] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5c9271bb-855d-4d80-beff-ea23c8e62c91" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.741779] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5c9271bb-855d-4d80-beff-ea23c8e62c91" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.741779] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5c9271bb-855d-4d80-beff-ea23c8e62c91" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.741779] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5c9271bb-855d-4d80-beff-ea23c8e62c91',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.241596] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('415b5ffc-5000-49bb-a961-29bcf6fcb57a',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.242894] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-415b5ffc-5000-49bb-a961-29bcf6fcb57a taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.243166] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-415b5ffc-5000-49bb-a961-29bcf6fcb57a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.243481] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5c9271bb-855d-4d80-beff-ea23c8e62c91 with status ACTIVE [ 840.246024] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.246024] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.246024] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.246024] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.246024] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.246024] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.246024] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.246024] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.246024] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.246024] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.246024] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.246024] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.246024] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.246024] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.246024] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.246024] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5c9271bb-855d-4d80-beff-ea23c8e62c91 is going to be updated. [ 840.269065] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.269065] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.269065] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.269065] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.269065] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.269065] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5c9271bb-855d-4d80-beff-ea23c8e62c91" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.744408] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('415b5ffc-5000-49bb-a961-29bcf6fcb57a',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.811380] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4843729c-bd07-48e1-9798-7dc90829718d in Status: SUCCESS [ 840.812121] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4843729c-bd07-48e1-9798-7dc90829718d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.994374] env[69232]: INFO networking_nsxv3.common.synchronization [req-0fbb69f6-4fb2-4ee0-9bbd-48a2c15287fa req-9cd3c217-a7da-4e96-9736-1c055723138b tempest-ServersTestMultiNic-1112914223 tempest-ServersTestMultiNic-1112914223-project-member] Enqueued Resource ID: 5e155778-3c23-43f6-a632-21f66a4311f8 with Priority: HIGHEST for action security_group_members [ 840.995149] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e155778-3c23-43f6-a632-21f66a4311f8 with Priority: HIGHEST for action security_group_members [ 840.995364] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e155778-3c23-43f6-a632-21f66a4311f8 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.995490] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e155778-3c23-43f6-a632-21f66a4311f8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.995562] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e155778-3c23-43f6-a632-21f66a4311f8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.995753] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e155778-3c23-43f6-a632-21f66a4311f8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.995886] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.995983] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.996049] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.996194] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.996271] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.996367] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5e155778-3c23-43f6-a632-21f66a4311f8',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.247257] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.247494] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.247494] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.247721] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.247811] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.248009] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 415b5ffc-5000-49bb-a961-29bcf6fcb57a is going to be created. [ 841.273625] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.273768] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.273839] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.274077] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.275530] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.285196] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 415b5ffc-5000-49bb-a961-29bcf6fcb57a in Status: UNINITIALIZED for 2s [ 841.303267] env[69232]: INFO networking_nsxv3.common.synchronization [req-0fbb69f6-4fb2-4ee0-9bbd-48a2c15287fa req-1e0fb526-b301-4d24-996c-446532119e0f tempest-ServersTestMultiNic-1112914223 tempest-ServersTestMultiNic-1112914223-project-member] Enqueued Resource ID: 5e155778-3c23-43f6-a632-21f66a4311f8 with Priority: HIGHEST for action security_group_members [ 841.303822] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e155778-3c23-43f6-a632-21f66a4311f8 with Priority: HIGHEST for action security_group_members [ 841.307019] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e155778-3c23-43f6-a632-21f66a4311f8 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.307019] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e155778-3c23-43f6-a632-21f66a4311f8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.498465] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.498699] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.498847] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.499022] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.524017] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.524673] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.524673] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.524673] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.524673] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.524938] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.524938] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e155778-3c23-43f6-a632-21f66a4311f8 is going to be updated. [ 841.557362] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.557362] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.557362] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.557362] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.557362] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.568110] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e155778-3c23-43f6-a632-21f66a4311f8 in Status: IN_PROGRESS for 2s [ 841.672913] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock network-559 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.673152] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "network-559" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.673289] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "network-559" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.673626] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "network-559" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.673898] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.676316] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.676504] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.679826] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.679826] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.679826] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 841.679826] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] NeedRegenerationException {{(pid=69232) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 841.679826] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] no value, waiting for create lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 841.679826] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] value creation lock acquired {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 841.679826] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 841.679826] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Calling creation function for not-yet-present value {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 841.679826] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 841.706181] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 841.706385] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=69232) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 841.706551] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Released creation lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 841.706921] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "network-559" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.707168] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock port-730fd954-ebf0-4b40-9ddb-1e1d5e12a97f taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.707368] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "port-730fd954-ebf0-4b40-9ddb-1e1d5e12a97f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.707521] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "port-730fd954-ebf0-4b40-9ddb-1e1d5e12a97f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.707831] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "port-730fd954-ebf0-4b40-9ddb-1e1d5e12a97f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.708008] env[69232]: DEBUG networking_nsxv3.api.rpc [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('730fd954-ebf0-4b40-9ddb-1e1d5e12a97f',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.210260] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.210600] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.210642] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.211217] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.211331] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.211600] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Segment Port 730fd954-ebf0-4b40-9ddb-1e1d5e12a97f not found, creating... [ 842.212049] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.212049] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.212249] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.212444] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.212736] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.213021] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.213227] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.213360] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.213584] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.213730] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.213914] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Resource: SegmentPort with ID: 730fd954-ebf0-4b40-9ddb-1e1d5e12a97f is going to be created. [ 842.233929] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.234174] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.234305] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.234588] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.234902] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.235143] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "port-730fd954-ebf0-4b40-9ddb-1e1d5e12a97f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.911911] env[69232]: INFO networking_nsxv3.common.synchronization [req-0fbb69f6-4fb2-4ee0-9bbd-48a2c15287fa req-43926788-ff41-4f4b-9cb3-c92f39d06caa service nova] Enqueued Resource ID: 5e155778-3c23-43f6-a632-21f66a4311f8 with Priority: HIGHEST for action security_group_rules [ 842.912114] env[69232]: INFO networking_nsxv3.common.synchronization [req-0fbb69f6-4fb2-4ee0-9bbd-48a2c15287fa req-43926788-ff41-4f4b-9cb3-c92f39d06caa service nova] Enqueued Resource ID: 5e155778-3c23-43f6-a632-21f66a4311f8 with Priority: HIGHEST for action security_group_members [ 842.912262] env[69232]: INFO networking_nsxv3.common.synchronization [req-0fbb69f6-4fb2-4ee0-9bbd-48a2c15287fa req-43926788-ff41-4f4b-9cb3-c92f39d06caa service nova] Enqueued Resource ID: 730fd954-ebf0-4b40-9ddb-1e1d5e12a97f with Priority: HIGHEST for action port [ 842.912501] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e155778-3c23-43f6-a632-21f66a4311f8 with Priority: HIGHEST for action security_group_rules [ 842.912632] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e155778-3c23-43f6-a632-21f66a4311f8 with Priority: HIGHEST for action security_group_members [ 842.912730] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 730fd954-ebf0-4b40-9ddb-1e1d5e12a97f with Priority: HIGHEST for action port [ 842.913463] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5e155778-3c23-43f6-a632-21f66a4311f8 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.913527] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5e155778-3c23-43f6-a632-21f66a4311f8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.913562] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5e155778-3c23-43f6-a632-21f66a4311f8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.913761] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5e155778-3c23-43f6-a632-21f66a4311f8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.913841] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5e155778-3c23-43f6-a632-21f66a4311f8',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.914708] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e155778-3c23-43f6-a632-21f66a4311f8 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.914778] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e155778-3c23-43f6-a632-21f66a4311f8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.914972] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-730fd954-ebf0-4b40-9ddb-1e1d5e12a97f taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.915082] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-730fd954-ebf0-4b40-9ddb-1e1d5e12a97f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.915165] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-730fd954-ebf0-4b40-9ddb-1e1d5e12a97f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.915504] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-730fd954-ebf0-4b40-9ddb-1e1d5e12a97f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.915504] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('730fd954-ebf0-4b40-9ddb-1e1d5e12a97f',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.296965] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 415b5ffc-5000-49bb-a961-29bcf6fcb57a in Status: SUCCESS [ 843.297299] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-415b5ffc-5000-49bb-a961-29bcf6fcb57a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.297460] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-415b5ffc-5000-49bb-a961-29bcf6fcb57a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.297681] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-415b5ffc-5000-49bb-a961-29bcf6fcb57a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.297914] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.298077] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.298170] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.298368] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.298475] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.298687] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-415b5ffc-5000-49bb-a961-29bcf6fcb57a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.298905] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('415b5ffc-5000-49bb-a961-29bcf6fcb57a',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.421786] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e155778-3c23-43f6-a632-21f66a4311f8 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.421931] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e155778-3c23-43f6-a632-21f66a4311f8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.422143] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 730fd954-ebf0-4b40-9ddb-1e1d5e12a97f with status ACTIVE [ 843.422311] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.422420] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.422523] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.422699] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.422768] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.422942] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.423064] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.423133] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.423290] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.423373] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.423543] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.423636] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.423708] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.423847] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.423918] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.424013] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 730fd954-ebf0-4b40-9ddb-1e1d5e12a97f is going to be updated. [ 843.447187] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.447311] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.447991] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.447991] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.447991] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.447991] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-730fd954-ebf0-4b40-9ddb-1e1d5e12a97f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.577145] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e155778-3c23-43f6-a632-21f66a4311f8 in Status: SUCCESS [ 843.577324] env[69232]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e155778-3c23-43f6-a632-21f66a4311f8 deletion is rescheduled due to dependency. [ 843.577458] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e155778-3c23-43f6-a632-21f66a4311f8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.577590] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e155778-3c23-43f6-a632-21f66a4311f8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.577809] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e155778-3c23-43f6-a632-21f66a4311f8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.577979] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.578107] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.578221] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.578327] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.578406] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.578522] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5e155778-3c23-43f6-a632-21f66a4311f8',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.620850] env[69232]: INFO networking_nsxv3.common.synchronization [req-9f764f7d-d730-4ed1-acef-9afed8391edf req-bb372961-5227-4c67-bd21-9dfde315f78a tempest-InstanceActionsTestJSON-369122008 tempest-InstanceActionsTestJSON-369122008-project-member] Enqueued Resource ID: 774040f6-0f3c-4707-b677-d815b078404c with Priority: HIGHEST for action security_group_members [ 843.624021] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 774040f6-0f3c-4707-b677-d815b078404c with Priority: HIGHEST for action security_group_members [ 843.624021] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-774040f6-0f3c-4707-b677-d815b078404c taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.624021] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-774040f6-0f3c-4707-b677-d815b078404c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.624021] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-774040f6-0f3c-4707-b677-d815b078404c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.624021] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-774040f6-0f3c-4707-b677-d815b078404c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.624021] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.624021] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.624021] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.624021] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.624021] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.624021] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('774040f6-0f3c-4707-b677-d815b078404c',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.801731] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-415b5ffc-5000-49bb-a961-29bcf6fcb57a taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.801944] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-415b5ffc-5000-49bb-a961-29bcf6fcb57a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.802026] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-415b5ffc-5000-49bb-a961-29bcf6fcb57a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.802265] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-415b5ffc-5000-49bb-a961-29bcf6fcb57a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.803879] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.803879] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.803879] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.803879] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.803879] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.803879] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-415b5ffc-5000-49bb-a961-29bcf6fcb57a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.803879] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-415b5ffc-5000-49bb-a961-29bcf6fcb57a taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.803879] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-415b5ffc-5000-49bb-a961-29bcf6fcb57a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.803879] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-415b5ffc-5000-49bb-a961-29bcf6fcb57a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.803879] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-415b5ffc-5000-49bb-a961-29bcf6fcb57a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.803879] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.803879] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.803879] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.803879] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.803879] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.804818] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-415b5ffc-5000-49bb-a961-29bcf6fcb57a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.804818] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('415b5ffc-5000-49bb-a961-29bcf6fcb57a',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.988103] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock network-965 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.988317] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "network-965" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.988448] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "network-965" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.988930] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "network-965" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.989443] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.989690] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.989819] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.990080] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.990307] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.990598] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 843.990796] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] NeedRegenerationException {{(pid=69232) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 843.990929] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] no value, waiting for create lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 843.991073] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] value creation lock acquired {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 843.991337] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 843.991486] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Calling creation function for not-yet-present value {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 843.991704] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 844.014318] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 844.014526] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69232) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 844.014720] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Released creation lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 844.014896] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "network-965" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.015300] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock port-f24cec30-11aa-436c-b166-d15e1f0e6d3d taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.015534] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "port-f24cec30-11aa-436c-b166-d15e1f0e6d3d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.015698] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "port-f24cec30-11aa-436c-b166-d15e1f0e6d3d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.016102] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "port-f24cec30-11aa-436c-b166-d15e1f0e6d3d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.016277] env[69232]: DEBUG networking_nsxv3.api.rpc [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f24cec30-11aa-436c-b166-d15e1f0e6d3d',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.081690] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5e155778-3c23-43f6-a632-21f66a4311f8',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.125761] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.125949] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.126107] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.126322] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.126433] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.126656] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.126777] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.126840] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.127662] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.127662] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.127662] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 774040f6-0f3c-4707-b677-d815b078404c is going to be updated. [ 844.157936] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.158507] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.158761] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.159155] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.159155] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.171777] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 774040f6-0f3c-4707-b677-d815b078404c in Status: IN_PROGRESS for 2s [ 844.231445] env[69232]: INFO networking_nsxv3.common.synchronization [req-3c9e1fd4-d21d-4387-9048-4719f581cad7 req-0fee54d1-9f6e-47a0-8557-25e17f5579b6 tempest-ServersAdminTestJSON-2143393640 tempest-ServersAdminTestJSON-2143393640-project-member] Enqueued Resource ID: d2391c01-2410-4874-a5a8-6da2d957e88c with Priority: HIGHEST for action security_group_members [ 844.231445] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2391c01-2410-4874-a5a8-6da2d957e88c with Priority: HIGHEST for action security_group_members [ 844.231618] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2391c01-2410-4874-a5a8-6da2d957e88c taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.231728] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2391c01-2410-4874-a5a8-6da2d957e88c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.231803] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2391c01-2410-4874-a5a8-6da2d957e88c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.234101] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2391c01-2410-4874-a5a8-6da2d957e88c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.234327] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.234459] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.234527] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.234791] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.234916] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.236017] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d2391c01-2410-4874-a5a8-6da2d957e88c',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.306896] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 415b5ffc-5000-49bb-a961-29bcf6fcb57a: rpc.has_security_group_logging(os_id): False [ 844.327918] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.327918] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.327918] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.328288] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.328288] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.328410] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.328485] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.328645] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.328732] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.328732] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.328902] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.328986] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.330188] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.330188] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.330188] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.330188] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.330188] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.330188] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.330188] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.330188] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.330188] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 415b5ffc-5000-49bb-a961-29bcf6fcb57a is going to be created. [ 844.395162] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.395162] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.395281] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.396021] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.396021] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.406646] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 415b5ffc-5000-49bb-a961-29bcf6fcb57a in Status: IN_PROGRESS for 2s [ 844.524890] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.525188] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.525283] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.525564] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.525722] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.525884] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Segment Port f24cec30-11aa-436c-b166-d15e1f0e6d3d not found, creating... [ 844.526180] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.526352] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.526475] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.526753] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.526903] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.527241] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.527412] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.527538] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.528487] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.529035] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.529035] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Resource: SegmentPort with ID: f24cec30-11aa-436c-b166-d15e1f0e6d3d is going to be created. [ 844.558245] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.558458] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.558630] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.558882] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.559141] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.559377] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "port-f24cec30-11aa-436c-b166-d15e1f0e6d3d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.584618] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5e155778-3c23-43f6-a632-21f66a4311f8',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.739395] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d2391c01-2410-4874-a5a8-6da2d957e88c',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.087202] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.087321] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.087321] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.087563] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.087651] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.087753] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e155778-3c23-43f6-a632-21f66a4311f8 is going to be updated. [ 845.101194] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock network-186 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.101194] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "network-186" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.101194] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "network-186" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.101194] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "network-186" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.101194] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.101194] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.101194] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.101194] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.101194] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.101194] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 845.101194] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] NeedRegenerationException {{(pid=69232) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 845.101194] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] no value, waiting for create lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 845.101194] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] value creation lock acquired {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 845.101771] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 845.101771] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Calling creation function for not-yet-present value {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 845.101771] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 845.125879] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 845.126159] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=69232) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 845.126246] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Released creation lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 845.126403] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "network-186" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.126882] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock port-6f7d27e5-a544-44e9-b2a1-137b8748928a taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.127092] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "port-6f7d27e5-a544-44e9-b2a1-137b8748928a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.127092] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "port-6f7d27e5-a544-44e9-b2a1-137b8748928a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.127396] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "port-6f7d27e5-a544-44e9-b2a1-137b8748928a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.127547] env[69232]: DEBUG networking_nsxv3.api.rpc [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6f7d27e5-a544-44e9-b2a1-137b8748928a',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.136571] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.136752] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.136752] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.137802] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.137802] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.151140] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e155778-3c23-43f6-a632-21f66a4311f8 in Status: IN_PROGRESS for 2s [ 845.245163] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d2391c01-2410-4874-a5a8-6da2d957e88c',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.631691] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.632365] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.632597] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.632892] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.633072] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.633234] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Segment Port 6f7d27e5-a544-44e9-b2a1-137b8748928a not found, creating... [ 845.633513] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.633684] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.633806] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.634048] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.634191] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.634481] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.634640] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.634758] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.634969] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.635545] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.635755] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Resource: SegmentPort with ID: 6f7d27e5-a544-44e9-b2a1-137b8748928a is going to be created. [ 845.657034] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.657447] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.657573] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.658015] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.658148] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.658476] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "port-6f7d27e5-a544-44e9-b2a1-137b8748928a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.729971] env[69232]: INFO networking_nsxv3.common.synchronization [req-0fbb69f6-4fb2-4ee0-9bbd-48a2c15287fa req-b03a95a3-833a-4fb2-90ab-95727ef88589 service nova] Enqueued Resource ID: 5e155778-3c23-43f6-a632-21f66a4311f8 with Priority: HIGHEST for action security_group_rules [ 845.731285] env[69232]: INFO networking_nsxv3.common.synchronization [req-0fbb69f6-4fb2-4ee0-9bbd-48a2c15287fa req-b03a95a3-833a-4fb2-90ab-95727ef88589 service nova] Enqueued Resource ID: 5e155778-3c23-43f6-a632-21f66a4311f8 with Priority: HIGHEST for action security_group_members [ 845.731607] env[69232]: INFO networking_nsxv3.common.synchronization [req-0fbb69f6-4fb2-4ee0-9bbd-48a2c15287fa req-b03a95a3-833a-4fb2-90ab-95727ef88589 service nova] Enqueued Resource ID: f24cec30-11aa-436c-b166-d15e1f0e6d3d with Priority: HIGHEST for action port [ 845.732693] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e155778-3c23-43f6-a632-21f66a4311f8 with Priority: HIGHEST for action security_group_rules [ 845.732959] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e155778-3c23-43f6-a632-21f66a4311f8 with Priority: HIGHEST for action security_group_members [ 845.733218] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f24cec30-11aa-436c-b166-d15e1f0e6d3d with Priority: HIGHEST for action port [ 845.734064] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5e155778-3c23-43f6-a632-21f66a4311f8 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.734064] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5e155778-3c23-43f6-a632-21f66a4311f8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.734491] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e155778-3c23-43f6-a632-21f66a4311f8 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.734701] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e155778-3c23-43f6-a632-21f66a4311f8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.735127] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-f24cec30-11aa-436c-b166-d15e1f0e6d3d taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.735324] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f24cec30-11aa-436c-b166-d15e1f0e6d3d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.735465] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f24cec30-11aa-436c-b166-d15e1f0e6d3d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.735996] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f24cec30-11aa-436c-b166-d15e1f0e6d3d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.738121] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f24cec30-11aa-436c-b166-d15e1f0e6d3d',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.748745] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.749016] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.749208] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.749492] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.749635] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.750887] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d2391c01-2410-4874-a5a8-6da2d957e88c is going to be updated. [ 845.800611] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.800611] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.800611] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.800611] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.800925] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.811686] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d2391c01-2410-4874-a5a8-6da2d957e88c in Status: IN_PROGRESS for 2s [ 846.185056] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 774040f6-0f3c-4707-b677-d815b078404c in Status: SUCCESS [ 846.187375] env[69232]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 774040f6-0f3c-4707-b677-d815b078404c deletion is rescheduled due to dependency. [ 846.187660] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-774040f6-0f3c-4707-b677-d815b078404c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.245032] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f24cec30-11aa-436c-b166-d15e1f0e6d3d with status ACTIVE [ 846.245032] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.245032] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.245032] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.245032] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.245032] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.245032] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.245032] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.245032] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.245032] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.245032] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.245032] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.245032] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.245032] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.245032] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.245032] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.245032] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f24cec30-11aa-436c-b166-d15e1f0e6d3d is going to be updated. [ 846.277205] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.277205] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.277205] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.277205] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.277205] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.277205] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f24cec30-11aa-436c-b166-d15e1f0e6d3d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.421503] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 415b5ffc-5000-49bb-a961-29bcf6fcb57a in Status: SUCCESS [ 846.421503] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-415b5ffc-5000-49bb-a961-29bcf6fcb57a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.589532] env[69232]: INFO networking_nsxv3.common.synchronization [req-3c9e1fd4-d21d-4387-9048-4719f581cad7 req-b467fff3-a7f1-4fd7-ad21-45cad88107d0 service nova] Enqueued Resource ID: d2391c01-2410-4874-a5a8-6da2d957e88c with Priority: HIGHEST for action security_group_rules [ 846.589779] env[69232]: INFO networking_nsxv3.common.synchronization [req-3c9e1fd4-d21d-4387-9048-4719f581cad7 req-b467fff3-a7f1-4fd7-ad21-45cad88107d0 service nova] Enqueued Resource ID: d2391c01-2410-4874-a5a8-6da2d957e88c with Priority: HIGHEST for action security_group_members [ 846.589962] env[69232]: INFO networking_nsxv3.common.synchronization [req-3c9e1fd4-d21d-4387-9048-4719f581cad7 req-b467fff3-a7f1-4fd7-ad21-45cad88107d0 service nova] Enqueued Resource ID: 6f7d27e5-a544-44e9-b2a1-137b8748928a with Priority: HIGHEST for action port [ 846.590246] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2391c01-2410-4874-a5a8-6da2d957e88c with Priority: HIGHEST for action security_group_rules [ 846.591107] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2391c01-2410-4874-a5a8-6da2d957e88c with Priority: HIGHEST for action security_group_members [ 846.591107] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f7d27e5-a544-44e9-b2a1-137b8748928a with Priority: HIGHEST for action port [ 846.591301] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d2391c01-2410-4874-a5a8-6da2d957e88c taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.591433] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d2391c01-2410-4874-a5a8-6da2d957e88c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.591521] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d2391c01-2410-4874-a5a8-6da2d957e88c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.591750] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d2391c01-2410-4874-a5a8-6da2d957e88c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.591858] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d2391c01-2410-4874-a5a8-6da2d957e88c',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.596915] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2391c01-2410-4874-a5a8-6da2d957e88c taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.597058] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2391c01-2410-4874-a5a8-6da2d957e88c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.597745] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-6f7d27e5-a544-44e9-b2a1-137b8748928a taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.597870] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6f7d27e5-a544-44e9-b2a1-137b8748928a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.597921] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6f7d27e5-a544-44e9-b2a1-137b8748928a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.598134] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6f7d27e5-a544-44e9-b2a1-137b8748928a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.598210] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6f7d27e5-a544-44e9-b2a1-137b8748928a',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.100435] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6f7d27e5-a544-44e9-b2a1-137b8748928a with status ACTIVE [ 847.100746] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.100882] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.100980] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.101272] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.101369] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.101588] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.101691] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.101757] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.101927] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.102016] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.102215] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.102312] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.102391] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.102577] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.102681] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.102796] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6f7d27e5-a544-44e9-b2a1-137b8748928a is going to be updated. [ 847.104016] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2391c01-2410-4874-a5a8-6da2d957e88c taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.104268] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2391c01-2410-4874-a5a8-6da2d957e88c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.130192] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.130399] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.130399] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.130627] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.130777] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.131050] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6f7d27e5-a544-44e9-b2a1-137b8748928a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.161761] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e155778-3c23-43f6-a632-21f66a4311f8 in Status: SUCCESS [ 847.162057] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e155778-3c23-43f6-a632-21f66a4311f8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.162592] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e155778-3c23-43f6-a632-21f66a4311f8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.162807] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e155778-3c23-43f6-a632-21f66a4311f8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.162990] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.163119] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.163185] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.163381] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.163466] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.163513] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5e155778-3c23-43f6-a632-21f66a4311f8',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.665534] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5e155778-3c23-43f6-a632-21f66a4311f8',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.826573] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d2391c01-2410-4874-a5a8-6da2d957e88c in Status: SUCCESS [ 847.826902] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2391c01-2410-4874-a5a8-6da2d957e88c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.827167] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2391c01-2410-4874-a5a8-6da2d957e88c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.827502] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2391c01-2410-4874-a5a8-6da2d957e88c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.827990] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.827990] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.827990] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.828197] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.828238] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.828313] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d2391c01-2410-4874-a5a8-6da2d957e88c',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.900780] env[69232]: INFO networking_nsxv3.common.synchronization [req-e3bd3699-07ec-45f5-af31-b11faf17f8de req-c45a80c6-20c2-4ade-b1d0-b7f3da7ea88b tempest-ServersAdminNegativeTestJSON-879816592 tempest-ServersAdminNegativeTestJSON-879816592-project-member] Enqueued Resource ID: 256e29a3-9ff8-45a1-805b-591f83c2a8b4 with Priority: HIGHEST for action security_group_members [ 847.901434] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 256e29a3-9ff8-45a1-805b-591f83c2a8b4 with Priority: HIGHEST for action security_group_members [ 847.901784] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-256e29a3-9ff8-45a1-805b-591f83c2a8b4 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.901930] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-256e29a3-9ff8-45a1-805b-591f83c2a8b4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.902025] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-256e29a3-9ff8-45a1-805b-591f83c2a8b4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.902571] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-256e29a3-9ff8-45a1-805b-591f83c2a8b4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.902571] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.902571] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.902571] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.902848] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.902848] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.902956] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('256e29a3-9ff8-45a1-805b-591f83c2a8b4',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.167931] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5e155778-3c23-43f6-a632-21f66a4311f8',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.333612] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d2391c01-2410-4874-a5a8-6da2d957e88c',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.406022] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.406277] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.406366] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.406646] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.406769] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.406989] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.407117] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.407182] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.407365] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.407513] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.407561] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 256e29a3-9ff8-45a1-805b-591f83c2a8b4 is going to be updated. [ 848.445629] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.445881] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.445979] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.446874] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.447134] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.458429] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 256e29a3-9ff8-45a1-805b-591f83c2a8b4 in Status: IN_PROGRESS for 2s [ 848.540785] env[69232]: INFO networking_nsxv3.common.synchronization [req-0c0a4d4f-bd9d-469f-ab0a-484e5b2616fb req-699c89cf-ee68-4d89-bdad-996104c3b4e9 tempest-ServerActionsTestOtherA-781098598 tempest-ServerActionsTestOtherA-781098598-project-member] Enqueued Resource ID: 3e5e65a3-941b-4419-9265-0dce9e80179e with Priority: HIGHEST for action security_group_members [ 848.541335] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e5e65a3-941b-4419-9265-0dce9e80179e with Priority: HIGHEST for action security_group_members [ 848.541648] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e5e65a3-941b-4419-9265-0dce9e80179e taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.541780] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e5e65a3-941b-4419-9265-0dce9e80179e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.541844] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e5e65a3-941b-4419-9265-0dce9e80179e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.544391] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e5e65a3-941b-4419-9265-0dce9e80179e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.544566] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.544680] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.544745] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.544987] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.545951] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.546077] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3e5e65a3-941b-4419-9265-0dce9e80179e',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.671343] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.671549] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.671602] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.672039] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.672184] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.672251] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e155778-3c23-43f6-a632-21f66a4311f8 is going to be updated. [ 848.713177] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.713177] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.713177] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.713503] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.713607] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.723932] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e155778-3c23-43f6-a632-21f66a4311f8 in Status: IN_PROGRESS for 2s [ 848.836668] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d2391c01-2410-4874-a5a8-6da2d957e88c',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.048294] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.048491] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.048491] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.048723] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.048810] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.049009] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.049157] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.049157] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.049307] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.049381] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.049462] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3e5e65a3-941b-4419-9265-0dce9e80179e already deleted. [ 849.049538] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e5e65a3-941b-4419-9265-0dce9e80179e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.276638] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock network-421 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.276957] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "network-421" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.277095] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "network-421" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.277430] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "network-421" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.277735] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.277915] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.278072] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.278300] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.278498] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.278730] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 849.278847] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] NeedRegenerationException {{(pid=69232) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 849.279021] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] no value, waiting for create lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 849.279386] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] value creation lock acquired {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 849.279386] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 849.279476] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Calling creation function for not-yet-present value {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 849.280091] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 849.298826] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 849.298991] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69232) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 849.299147] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Released creation lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 849.299330] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "network-421" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.299659] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock port-8e624647-8818-4a7e-97c4-ab8e589ad4b4 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.299833] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "port-8e624647-8818-4a7e-97c4-ab8e589ad4b4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.299958] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "port-8e624647-8818-4a7e-97c4-ab8e589ad4b4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.300331] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "port-8e624647-8818-4a7e-97c4-ab8e589ad4b4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.300474] env[69232]: DEBUG networking_nsxv3.api.rpc [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8e624647-8818-4a7e-97c4-ab8e589ad4b4',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.339688] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.339817] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.339817] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.340456] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.340456] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.340456] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d2391c01-2410-4874-a5a8-6da2d957e88c is going to be updated. [ 849.374213] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.374408] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.374408] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.374626] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.374769] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.384821] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d2391c01-2410-4874-a5a8-6da2d957e88c in Status: IN_PROGRESS for 2s [ 849.803207] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.803207] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.803207] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.803207] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.803561] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.803561] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Segment Port 8e624647-8818-4a7e-97c4-ab8e589ad4b4 not found, creating... [ 849.803793] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.803968] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.804108] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.804348] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.804489] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.804793] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.804956] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.805133] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.805400] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.805602] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.805783] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Resource: SegmentPort with ID: 8e624647-8818-4a7e-97c4-ab8e589ad4b4 is going to be created. [ 849.827400] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.827659] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.827726] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.828098] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.828899] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.829184] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "port-8e624647-8818-4a7e-97c4-ab8e589ad4b4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.469621] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 256e29a3-9ff8-45a1-805b-591f83c2a8b4 in Status: SUCCESS [ 850.470054] env[69232]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 256e29a3-9ff8-45a1-805b-591f83c2a8b4 deletion is rescheduled due to dependency. [ 850.470054] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-256e29a3-9ff8-45a1-805b-591f83c2a8b4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.735832] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e155778-3c23-43f6-a632-21f66a4311f8 in Status: SUCCESS [ 850.736061] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e155778-3c23-43f6-a632-21f66a4311f8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.736245] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e155778-3c23-43f6-a632-21f66a4311f8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.736473] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e155778-3c23-43f6-a632-21f66a4311f8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.736685] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.736808] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.736867] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.737049] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.737124] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.737208] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e155778-3c23-43f6-a632-21f66a4311f8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.737311] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5e155778-3c23-43f6-a632-21f66a4311f8',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.742454] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e155778-3c23-43f6-a632-21f66a4311f8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.742454] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e155778-3c23-43f6-a632-21f66a4311f8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.742454] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.742454] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.742454] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.742454] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.742454] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.742454] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5e155778-3c23-43f6-a632-21f66a4311f8',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.131958] env[69232]: INFO networking_nsxv3.common.synchronization [req-0c0a4d4f-bd9d-469f-ab0a-484e5b2616fb req-d8104495-3253-4380-a796-23e6e41bb9ac service nova] Enqueued Resource ID: 3e5e65a3-941b-4419-9265-0dce9e80179e with Priority: HIGHEST for action security_group_rules [ 851.132751] env[69232]: INFO networking_nsxv3.common.synchronization [req-0c0a4d4f-bd9d-469f-ab0a-484e5b2616fb req-d8104495-3253-4380-a796-23e6e41bb9ac service nova] Enqueued Resource ID: 3e5e65a3-941b-4419-9265-0dce9e80179e with Priority: HIGHEST for action security_group_members [ 851.133576] env[69232]: INFO networking_nsxv3.common.synchronization [req-0c0a4d4f-bd9d-469f-ab0a-484e5b2616fb req-d8104495-3253-4380-a796-23e6e41bb9ac service nova] Enqueued Resource ID: 8e624647-8818-4a7e-97c4-ab8e589ad4b4 with Priority: HIGHEST for action port [ 851.134233] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e5e65a3-941b-4419-9265-0dce9e80179e with Priority: HIGHEST for action security_group_rules [ 851.134491] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e5e65a3-941b-4419-9265-0dce9e80179e with Priority: HIGHEST for action security_group_members [ 851.134491] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e624647-8818-4a7e-97c4-ab8e589ad4b4 with Priority: HIGHEST for action port [ 851.137151] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3e5e65a3-941b-4419-9265-0dce9e80179e taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.137331] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3e5e65a3-941b-4419-9265-0dce9e80179e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.137405] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3e5e65a3-941b-4419-9265-0dce9e80179e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.137633] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3e5e65a3-941b-4419-9265-0dce9e80179e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.137720] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3e5e65a3-941b-4419-9265-0dce9e80179e',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.138968] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e5e65a3-941b-4419-9265-0dce9e80179e taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.138968] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e5e65a3-941b-4419-9265-0dce9e80179e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.138968] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e5e65a3-941b-4419-9265-0dce9e80179e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.140564] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e5e65a3-941b-4419-9265-0dce9e80179e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.140564] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.140564] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.140564] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.140564] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.140564] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.140993] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3e5e65a3-941b-4419-9265-0dce9e80179e',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.143245] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-8e624647-8818-4a7e-97c4-ab8e589ad4b4 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.143410] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8e624647-8818-4a7e-97c4-ab8e589ad4b4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.143611] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8e624647-8818-4a7e-97c4-ab8e589ad4b4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.143841] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8e624647-8818-4a7e-97c4-ab8e589ad4b4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.144432] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8e624647-8818-4a7e-97c4-ab8e589ad4b4',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.241183] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e155778-3c23-43f6-a632-21f66a4311f8 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.241373] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e155778-3c23-43f6-a632-21f66a4311f8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.244852] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5e155778-3c23-43f6-a632-21f66a4311f8',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.394676] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d2391c01-2410-4874-a5a8-6da2d957e88c in Status: SUCCESS [ 851.394880] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2391c01-2410-4874-a5a8-6da2d957e88c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.395068] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2391c01-2410-4874-a5a8-6da2d957e88c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.395283] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2391c01-2410-4874-a5a8-6da2d957e88c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.395480] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.395578] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.397479] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.397479] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.397479] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.397479] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2391c01-2410-4874-a5a8-6da2d957e88c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.397479] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d2391c01-2410-4874-a5a8-6da2d957e88c',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.648997] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e5e65a3-941b-4419-9265-0dce9e80179e taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.649365] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e5e65a3-941b-4419-9265-0dce9e80179e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.649365] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3e5e65a3-941b-4419-9265-0dce9e80179e',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.654020] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8e624647-8818-4a7e-97c4-ab8e589ad4b4 with status ACTIVE [ 851.654020] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.654020] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.654020] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.654020] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.654020] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.654020] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.654020] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.654020] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.654020] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.654020] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.654020] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.654020] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.654020] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.654705] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.654705] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.654705] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8e624647-8818-4a7e-97c4-ab8e589ad4b4 is going to be updated. [ 851.675054] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.675227] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.675277] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.675487] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.675624] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.675787] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8e624647-8818-4a7e-97c4-ab8e589ad4b4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.748916] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5e155778-3c23-43f6-a632-21f66a4311f8',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.752514] env[69232]: INFO networking_nsxv3.common.synchronization [req-70caafcb-43e4-47ab-af22-561b790978e2 req-a96bcefc-3add-420d-9064-cd75a9d6172d tempest-ImagesNegativeTestJSON-1337708046 tempest-ImagesNegativeTestJSON-1337708046-project-member] Enqueued Resource ID: 415b5ffc-5000-49bb-a961-29bcf6fcb57a with Priority: HIGHEST for action security_group_members [ 851.753102] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 415b5ffc-5000-49bb-a961-29bcf6fcb57a with Priority: HIGHEST for action security_group_members [ 851.754169] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-415b5ffc-5000-49bb-a961-29bcf6fcb57a taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.754169] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-415b5ffc-5000-49bb-a961-29bcf6fcb57a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.754169] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-415b5ffc-5000-49bb-a961-29bcf6fcb57a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.754169] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-415b5ffc-5000-49bb-a961-29bcf6fcb57a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.758736] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.758736] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.758736] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.758736] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.758736] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.758736] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('415b5ffc-5000-49bb-a961-29bcf6fcb57a',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.899123] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2391c01-2410-4874-a5a8-6da2d957e88c taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.899320] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2391c01-2410-4874-a5a8-6da2d957e88c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.899628] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2391c01-2410-4874-a5a8-6da2d957e88c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.899628] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2391c01-2410-4874-a5a8-6da2d957e88c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.899763] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.900620] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.900620] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.900620] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.900620] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.900620] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2391c01-2410-4874-a5a8-6da2d957e88c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.900620] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2391c01-2410-4874-a5a8-6da2d957e88c taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.900620] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2391c01-2410-4874-a5a8-6da2d957e88c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.900620] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2391c01-2410-4874-a5a8-6da2d957e88c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.901295] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2391c01-2410-4874-a5a8-6da2d957e88c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.901295] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.901295] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.901295] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.901295] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.901295] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.901605] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2391c01-2410-4874-a5a8-6da2d957e88c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.901605] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d2391c01-2410-4874-a5a8-6da2d957e88c',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.131584] env[69232]: INFO networking_nsxv3.common.synchronization [req-94a68dac-9f24-4f2c-85ef-ad9ef5617371 req-bf760c3e-9251-482f-9480-d32d0b8af1a4 tempest-SecurityGroupsTestJSON-1763653160 tempest-SecurityGroupsTestJSON-1763653160-project-member] Enqueued Resource ID: 0a7a78fa-fad0-458c-afc2-e1d98c9176ab with Priority: HIGHEST for action security_group_members [ 852.132570] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a7a78fa-fad0-458c-afc2-e1d98c9176ab with Priority: HIGHEST for action security_group_members [ 852.132570] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.132570] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.132770] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.132806] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.133358] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.133358] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.133358] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.133358] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.133594] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.133594] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0a7a78fa-fad0-458c-afc2-e1d98c9176ab',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.151517] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3e5e65a3-941b-4419-9265-0dce9e80179e',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.252018] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.252267] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.252341] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.252554] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.252643] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.252740] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e155778-3c23-43f6-a632-21f66a4311f8 is going to be updated. [ 852.259664] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.259817] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.259860] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.260089] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.260261] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.260369] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.260480] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.260542] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.260699] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.260808] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.260899] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 415b5ffc-5000-49bb-a961-29bcf6fcb57a is going to be updated. [ 852.291220] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.291362] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.291434] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.292677] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.292844] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.295046] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.295209] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.295259] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.295438] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.295568] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.307044] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e155778-3c23-43f6-a632-21f66a4311f8 in Status: IN_PROGRESS for 2s [ 852.307755] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 415b5ffc-5000-49bb-a961-29bcf6fcb57a in Status: IN_PROGRESS for 2s [ 852.404680] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d2391c01-2410-4874-a5a8-6da2d957e88c: rpc.has_security_group_logging(os_id): False [ 852.472677] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.472853] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.472934] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.473178] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.473286] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.473520] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.473641] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.473700] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.473859] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.473970] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.474179] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.474278] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.474341] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.474491] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.474574] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.474763] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.474875] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.474939] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.475194] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.475290] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.475382] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d2391c01-2410-4874-a5a8-6da2d957e88c is going to be updated. [ 852.547441] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.547441] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.547441] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.547703] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.547842] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.566616] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d2391c01-2410-4874-a5a8-6da2d957e88c in Status: IN_PROGRESS for 2s [ 852.637493] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0a7a78fa-fad0-458c-afc2-e1d98c9176ab',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.655334] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.655737] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.655737] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.655737] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.655877] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.656026] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3e5e65a3-941b-4419-9265-0dce9e80179e is going to be created. [ 852.707158] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.707366] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.707610] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.707705] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.707840] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.728642] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e5e65a3-941b-4419-9265-0dce9e80179e in Status: UNINITIALIZED for 2s [ 852.977515] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock network-505 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.977697] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "network-505" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.977835] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "network-505" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.978713] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "network-505" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.979057] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.980199] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.980199] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.980199] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.980199] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.980199] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 852.980199] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] NeedRegenerationException {{(pid=69232) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 852.980470] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] no value, waiting for create lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 852.980470] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] value creation lock acquired {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 852.980570] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 852.980822] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Calling creation function for not-yet-present value {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 852.980822] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 853.002049] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 853.002049] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69232) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 853.002049] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Released creation lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 853.002359] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "network-505" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.002607] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock port-9fc0b536-c43d-475e-8ce4-888e8fc85e0b taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.002809] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "port-9fc0b536-c43d-475e-8ce4-888e8fc85e0b" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.002950] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "port-9fc0b536-c43d-475e-8ce4-888e8fc85e0b" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.003574] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "port-9fc0b536-c43d-475e-8ce4-888e8fc85e0b" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.003751] env[69232]: DEBUG networking_nsxv3.api.rpc [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9fc0b536-c43d-475e-8ce4-888e8fc85e0b',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.141676] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0a7a78fa-fad0-458c-afc2-e1d98c9176ab',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.506476] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.506756] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.506924] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.507264] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.507470] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.507666] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Segment Port 9fc0b536-c43d-475e-8ce4-888e8fc85e0b not found, creating... [ 853.507969] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.508185] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.508317] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.508550] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.508697] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.509073] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.509240] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.509362] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.509574] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.509709] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.509855] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Resource: SegmentPort with ID: 9fc0b536-c43d-475e-8ce4-888e8fc85e0b is going to be created. [ 853.532061] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.532061] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.532061] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.532350] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.532350] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.532574] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "port-9fc0b536-c43d-475e-8ce4-888e8fc85e0b" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.648757] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.648949] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.649016] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.649239] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.649334] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.649437] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a7a78fa-fad0-458c-afc2-e1d98c9176ab is going to be updated. [ 853.695783] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.696359] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.696529] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.696824] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.697060] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.714488] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a7a78fa-fad0-458c-afc2-e1d98c9176ab in Status: IN_PROGRESS for 2s [ 854.326044] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e155778-3c23-43f6-a632-21f66a4311f8 in Status: SUCCESS [ 854.326044] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e155778-3c23-43f6-a632-21f66a4311f8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.326044] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 415b5ffc-5000-49bb-a961-29bcf6fcb57a in Status: SUCCESS [ 854.326044] env[69232]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 415b5ffc-5000-49bb-a961-29bcf6fcb57a deletion is rescheduled due to dependency. [ 854.326044] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-415b5ffc-5000-49bb-a961-29bcf6fcb57a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.328813] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e155778-3c23-43f6-a632-21f66a4311f8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.329101] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e155778-3c23-43f6-a632-21f66a4311f8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.332495] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.332781] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.332781] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.332932] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.333059] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.333408] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e155778-3c23-43f6-a632-21f66a4311f8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.333480] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e155778-3c23-43f6-a632-21f66a4311f8 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.333624] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e155778-3c23-43f6-a632-21f66a4311f8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.333714] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e155778-3c23-43f6-a632-21f66a4311f8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.333987] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e155778-3c23-43f6-a632-21f66a4311f8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.334170] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.334317] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.334553] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.334763] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.334763] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.334833] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e155778-3c23-43f6-a632-21f66a4311f8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.335292] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5e155778-3c23-43f6-a632-21f66a4311f8',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.484434] env[69232]: INFO networking_nsxv3.common.synchronization [req-94a68dac-9f24-4f2c-85ef-ad9ef5617371 req-0c402eda-4a81-404e-8f10-3a88aa47ca01 service nova] Enqueued Resource ID: 0a7a78fa-fad0-458c-afc2-e1d98c9176ab with Priority: HIGHEST for action security_group_rules [ 854.484674] env[69232]: INFO networking_nsxv3.common.synchronization [req-94a68dac-9f24-4f2c-85ef-ad9ef5617371 req-0c402eda-4a81-404e-8f10-3a88aa47ca01 service nova] Enqueued Resource ID: 0a7a78fa-fad0-458c-afc2-e1d98c9176ab with Priority: HIGHEST for action security_group_members [ 854.484893] env[69232]: INFO networking_nsxv3.common.synchronization [req-94a68dac-9f24-4f2c-85ef-ad9ef5617371 req-0c402eda-4a81-404e-8f10-3a88aa47ca01 service nova] Enqueued Resource ID: 9fc0b536-c43d-475e-8ce4-888e8fc85e0b with Priority: HIGHEST for action port [ 854.486126] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a7a78fa-fad0-458c-afc2-e1d98c9176ab with Priority: HIGHEST for action security_group_rules [ 854.486288] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a7a78fa-fad0-458c-afc2-e1d98c9176ab with Priority: HIGHEST for action security_group_members [ 854.486354] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9fc0b536-c43d-475e-8ce4-888e8fc85e0b with Priority: HIGHEST for action port [ 854.488328] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0a7a78fa-fad0-458c-afc2-e1d98c9176ab taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.488953] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.488953] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.488953] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.488953] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0a7a78fa-fad0-458c-afc2-e1d98c9176ab',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.490153] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.490277] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.490498] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-9fc0b536-c43d-475e-8ce4-888e8fc85e0b taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.490613] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9fc0b536-c43d-475e-8ce4-888e8fc85e0b" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.490678] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9fc0b536-c43d-475e-8ce4-888e8fc85e0b" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.490894] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9fc0b536-c43d-475e-8ce4-888e8fc85e0b" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.490972] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9fc0b536-c43d-475e-8ce4-888e8fc85e0b',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.585203] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d2391c01-2410-4874-a5a8-6da2d957e88c in Status: SUCCESS [ 854.585428] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d2391c01-2410-4874-a5a8-6da2d957e88c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.739366] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e5e65a3-941b-4419-9265-0dce9e80179e in Status: SUCCESS [ 854.739366] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e5e65a3-941b-4419-9265-0dce9e80179e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.739366] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e5e65a3-941b-4419-9265-0dce9e80179e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.739366] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e5e65a3-941b-4419-9265-0dce9e80179e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.739366] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.739366] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.739366] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.739913] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.739913] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.739913] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e5e65a3-941b-4419-9265-0dce9e80179e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.739913] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3e5e65a3-941b-4419-9265-0dce9e80179e',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.841861] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5e155778-3c23-43f6-a632-21f66a4311f8: rpc.has_security_group_logging(os_id): False [ 854.859307] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.859307] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.859307] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.859307] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.859307] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.859307] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.859307] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.859307] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.859702] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.859702] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.859702] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.859949] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.859949] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.859949] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.860060] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.863018] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.864446] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.864557] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.864753] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.864908] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.865053] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5e155778-3c23-43f6-a632-21f66a4311f8 is going to be updated. [ 854.940794] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.941015] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.941088] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.941297] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.941628] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.956181] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5e155778-3c23-43f6-a632-21f66a4311f8 in Status: IN_PROGRESS for 2s [ 854.994792] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.994968] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.995145] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9fc0b536-c43d-475e-8ce4-888e8fc85e0b with status ACTIVE [ 854.995316] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.995421] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.999161] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.999449] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.999550] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.999808] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.999985] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.000042] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.000210] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.000298] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.000596] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.000678] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.000715] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.000855] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.000933] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.001055] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9fc0b536-c43d-475e-8ce4-888e8fc85e0b is going to be updated. [ 855.026452] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.026600] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.026699] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.026870] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.027057] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.027343] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9fc0b536-c43d-475e-8ce4-888e8fc85e0b" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.241984] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3e5e65a3-941b-4419-9265-0dce9e80179e',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.727436] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a7a78fa-fad0-458c-afc2-e1d98c9176ab in Status: SUCCESS [ 855.727668] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.727844] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.728065] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.728250] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.728367] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.728434] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.728581] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.728664] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.728810] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0a7a78fa-fad0-458c-afc2-e1d98c9176ab',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.743944] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3e5e65a3-941b-4419-9265-0dce9e80179e: rpc.has_security_group_logging(os_id): False [ 855.761581] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.761721] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.761794] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.762059] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.762112] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.762324] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.762425] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.762482] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.762637] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.762718] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.762803] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3e5e65a3-941b-4419-9265-0dce9e80179e is going to be created. [ 855.830326] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.830326] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.830326] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.830732] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.830732] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.847056] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3e5e65a3-941b-4419-9265-0dce9e80179e in Status: IN_PROGRESS for 2s [ 856.233246] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0a7a78fa-fad0-458c-afc2-e1d98c9176ab',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.579028] env[69232]: INFO networking_nsxv3.common.synchronization [req-ce492939-ce87-46ae-b28b-407020ded98d req-5cf1732d-603a-4f68-81de-48abfe9fda21 tempest-ServersTestMultiNic-1112914223 tempest-ServersTestMultiNic-1112914223-project-member] Enqueued Resource ID: 5e155778-3c23-43f6-a632-21f66a4311f8 with Priority: HIGHEST for action security_group_members [ 856.579162] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e155778-3c23-43f6-a632-21f66a4311f8 with Priority: HIGHEST for action security_group_members [ 856.579404] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e155778-3c23-43f6-a632-21f66a4311f8 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.579582] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e155778-3c23-43f6-a632-21f66a4311f8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.579582] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e155778-3c23-43f6-a632-21f66a4311f8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.579827] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e155778-3c23-43f6-a632-21f66a4311f8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.580528] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.580679] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.580750] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.580994] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.581095] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.581221] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5e155778-3c23-43f6-a632-21f66a4311f8',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.735973] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0a7a78fa-fad0-458c-afc2-e1d98c9176ab',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.938091] env[69232]: INFO networking_nsxv3.common.synchronization [req-ce492939-ce87-46ae-b28b-407020ded98d req-4821142b-3fd0-4f16-92f9-7b41a2741a4c tempest-ServersTestMultiNic-1112914223 tempest-ServersTestMultiNic-1112914223-project-member] Enqueued Resource ID: 5e155778-3c23-43f6-a632-21f66a4311f8 with Priority: HIGHEST for action security_group_members [ 856.938525] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e155778-3c23-43f6-a632-21f66a4311f8 with Priority: HIGHEST for action security_group_members [ 856.943025] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e155778-3c23-43f6-a632-21f66a4311f8 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.943025] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e155778-3c23-43f6-a632-21f66a4311f8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.973790] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5e155778-3c23-43f6-a632-21f66a4311f8 in Status: SUCCESS [ 856.974051] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5e155778-3c23-43f6-a632-21f66a4311f8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.974485] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5e155778-3c23-43f6-a632-21f66a4311f8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.974692] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5e155778-3c23-43f6-a632-21f66a4311f8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.974773] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5e155778-3c23-43f6-a632-21f66a4311f8',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.083787] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5e155778-3c23-43f6-a632-21f66a4311f8',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.239049] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.241431] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.241431] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.241431] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.241431] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.241431] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a7a78fa-fad0-458c-afc2-e1d98c9176ab is going to be updated. [ 857.267930] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.270173] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.270173] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.270173] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.270173] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.277742] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a7a78fa-fad0-458c-afc2-e1d98c9176ab in Status: IN_PROGRESS for 2s [ 857.496993] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.499024] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.499024] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.499024] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.499024] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.499024] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5e155778-3c23-43f6-a632-21f66a4311f8 is going to be deleted. [ 857.555864] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.556035] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.556083] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.556304] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.556397] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.556516] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5e155778-3c23-43f6-a632-21f66a4311f8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.587202] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5e155778-3c23-43f6-a632-21f66a4311f8',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.863454] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3e5e65a3-941b-4419-9265-0dce9e80179e in Status: SUCCESS [ 857.863685] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3e5e65a3-941b-4419-9265-0dce9e80179e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.089325] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.089657] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.089657] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.089751] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.089998] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.089998] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e155778-3c23-43f6-a632-21f66a4311f8 is going to be updated. [ 858.121949] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.122141] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.122228] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.122423] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.122566] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.131955] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e155778-3c23-43f6-a632-21f66a4311f8 in Status: IN_PROGRESS for 2s [ 859.119408] env[69232]: INFO networking_nsxv3.common.synchronization [None req-dc24d32f-57e8-42d7-aca1-6ad84a99e10f None None] Enqueued Resource ID: 0e00758f-98d4-431e-a651-53d9c15459cf with Priority: HIGHEST for action port [ 859.119987] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e00758f-98d4-431e-a651-53d9c15459cf with Priority: HIGHEST for action port [ 859.120308] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-0e00758f-98d4-431e-a651-53d9c15459cf taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.120431] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0e00758f-98d4-431e-a651-53d9c15459cf" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.120501] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0e00758f-98d4-431e-a651-53d9c15459cf" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.120802] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0e00758f-98d4-431e-a651-53d9c15459cf" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.121196] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0e00758f-98d4-431e-a651-53d9c15459cf',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.291384] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a7a78fa-fad0-458c-afc2-e1d98c9176ab in Status: SUCCESS [ 859.291384] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.291384] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.291384] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.291607] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.291652] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.291689] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.293250] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.293370] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.293488] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.293605] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0a7a78fa-fad0-458c-afc2-e1d98c9176ab',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.625243] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0e00758f-98d4-431e-a651-53d9c15459cf [ 859.625243] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.625243] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.625243] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.625243] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.625243] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.625243] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0e00758f-98d4-431e-a651-53d9c15459cf already deleted. [ 859.625243] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0e00758f-98d4-431e-a651-53d9c15459cf" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.761261] env[69232]: INFO networking_nsxv3.common.synchronization [None req-5e346410-7471-4661-8bf3-c504db751abf tempest-ServerActionsV293TestJSON-86347733 tempest-ServerActionsV293TestJSON-86347733-project-member] Enqueued Resource ID: b5e09fe8-8a4e-445c-b1d3-bf8c7339160c with Priority: HIGHEST for action security_group_rules [ 859.761832] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5e09fe8-8a4e-445c-b1d3-bf8c7339160c with Priority: HIGHEST for action security_group_rules [ 859.762277] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b5e09fe8-8a4e-445c-b1d3-bf8c7339160c taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.762277] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b5e09fe8-8a4e-445c-b1d3-bf8c7339160c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.762451] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b5e09fe8-8a4e-445c-b1d3-bf8c7339160c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.762687] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b5e09fe8-8a4e-445c-b1d3-bf8c7339160c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.762687] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b5e09fe8-8a4e-445c-b1d3-bf8c7339160c',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.798096] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.798096] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.798096] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.798329] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.798402] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.798510] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.798573] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.798783] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.798849] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.798923] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.799146] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.799224] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.799282] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.799446] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.799572] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.799681] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.799717] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.799850] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.799928] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.800016] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.800710] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0a7a78fa-fad0-458c-afc2-e1d98c9176ab',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.867966] env[69232]: INFO networking_nsxv3.common.synchronization [None req-873b0cdc-e5f1-411c-b860-5e509cd3a769 tempest-ServerActionsV293TestJSON-86347733 tempest-ServerActionsV293TestJSON-86347733-project-member] Enqueued Resource ID: b5e09fe8-8a4e-445c-b1d3-bf8c7339160c with Priority: HIGHEST for action security_group_rules [ 859.870645] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5e09fe8-8a4e-445c-b1d3-bf8c7339160c with Priority: HIGHEST for action security_group_rules [ 859.871428] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b5e09fe8-8a4e-445c-b1d3-bf8c7339160c taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.871512] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b5e09fe8-8a4e-445c-b1d3-bf8c7339160c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.153665] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e155778-3c23-43f6-a632-21f66a4311f8 in Status: SUCCESS [ 860.153929] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e155778-3c23-43f6-a632-21f66a4311f8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.153929] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e155778-3c23-43f6-a632-21f66a4311f8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.154089] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e155778-3c23-43f6-a632-21f66a4311f8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.154545] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.154545] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.154545] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.154690] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.154690] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.154778] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5e155778-3c23-43f6-a632-21f66a4311f8',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.294582] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.296738] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.296738] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.296738] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.296738] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.296738] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b5e09fe8-8a4e-445c-b1d3-bf8c7339160c already deleted. [ 860.296738] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b5e09fe8-8a4e-445c-b1d3-bf8c7339160c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.296738] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b5e09fe8-8a4e-445c-b1d3-bf8c7339160c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.296738] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b5e09fe8-8a4e-445c-b1d3-bf8c7339160c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.296738] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b5e09fe8-8a4e-445c-b1d3-bf8c7339160c',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.303728] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0a7a78fa-fad0-458c-afc2-e1d98c9176ab: rpc.has_security_group_logging(os_id): False [ 860.325206] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.325206] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.325206] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.325206] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.325206] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.325206] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.325206] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.325206] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.325206] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.325206] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.325206] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.325206] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.325206] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.325206] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.325206] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.325731] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.325731] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.325731] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.326443] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.328300] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.328300] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0a7a78fa-fad0-458c-afc2-e1d98c9176ab is going to be updated. [ 860.408495] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.408495] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.408495] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.408495] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.408495] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.431183] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0a7a78fa-fad0-458c-afc2-e1d98c9176ab in Status: IN_PROGRESS for 2s [ 860.658021] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.658021] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.658021] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.658384] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.658384] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.658852] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.659023] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.659116] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.659502] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.659560] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.659651] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e155778-3c23-43f6-a632-21f66a4311f8 is going to be deleted. [ 860.689841] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.689983] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.690064] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.690398] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.690493] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.690596] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e155778-3c23-43f6-a632-21f66a4311f8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.823311] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.823477] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.823629] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.823750] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.824139] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.824139] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b5e09fe8-8a4e-445c-b1d3-bf8c7339160c already deleted. [ 860.824139] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b5e09fe8-8a4e-445c-b1d3-bf8c7339160c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.540326] env[69232]: INFO networking_nsxv3.common.synchronization [None req-e5407596-49ff-4546-a7b9-f6549ccb4a6f None None] Enqueued Resource ID: 7b09ddff-91de-4bb1-911c-320e364f84ad with Priority: HIGHEST for action port [ 861.540326] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b09ddff-91de-4bb1-911c-320e364f84ad with Priority: HIGHEST for action port [ 861.540658] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-7b09ddff-91de-4bb1-911c-320e364f84ad taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.540658] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7b09ddff-91de-4bb1-911c-320e364f84ad" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.540951] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7b09ddff-91de-4bb1-911c-320e364f84ad" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.541453] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7b09ddff-91de-4bb1-911c-320e364f84ad" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.541453] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7b09ddff-91de-4bb1-911c-320e364f84ad',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.043648] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7b09ddff-91de-4bb1-911c-320e364f84ad [ 862.043983] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.044210] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.044439] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.045612] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.045777] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.045942] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7b09ddff-91de-4bb1-911c-320e364f84ad already deleted. [ 862.046100] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7b09ddff-91de-4bb1-911c-320e364f84ad" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.449939] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0a7a78fa-fad0-458c-afc2-e1d98c9176ab in Status: SUCCESS [ 862.450771] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.279452] env[69232]: INFO networking_nsxv3.common.synchronization [req-4bca64db-856d-49e6-a40c-701f77c5db70 req-a5c095f7-6857-454c-ad8a-54e6791cdb8f tempest-SecurityGroupsTestJSON-1763653160 tempest-SecurityGroupsTestJSON-1763653160-project-member] Enqueued Resource ID: 0a7a78fa-fad0-458c-afc2-e1d98c9176ab with Priority: HIGHEST for action security_group_members [ 863.279452] env[69232]: INFO networking_nsxv3.common.synchronization [req-4bca64db-856d-49e6-a40c-701f77c5db70 req-a5c095f7-6857-454c-ad8a-54e6791cdb8f tempest-SecurityGroupsTestJSON-1763653160 tempest-SecurityGroupsTestJSON-1763653160-project-member] Enqueued Resource ID: 25f63f04-629a-4a58-8545-3a1625dc152b with Priority: HIGHEST for action security_group_members [ 863.279947] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a7a78fa-fad0-458c-afc2-e1d98c9176ab with Priority: HIGHEST for action security_group_members [ 863.280544] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25f63f04-629a-4a58-8545-3a1625dc152b with Priority: HIGHEST for action security_group_members [ 863.280544] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.280544] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.280676] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.282034] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.282034] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.282034] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.282034] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.282034] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.282034] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.282034] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0a7a78fa-fad0-458c-afc2-e1d98c9176ab',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.282594] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-25f63f04-629a-4a58-8545-3a1625dc152b taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.282751] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-25f63f04-629a-4a58-8545-3a1625dc152b" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.282789] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-25f63f04-629a-4a58-8545-3a1625dc152b" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.282981] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-25f63f04-629a-4a58-8545-3a1625dc152b" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.284973] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.284973] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.284973] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.284973] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.284973] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.284973] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('25f63f04-629a-4a58-8545-3a1625dc152b',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.353446] env[69232]: INFO networking_nsxv3.common.synchronization [req-4bca64db-856d-49e6-a40c-701f77c5db70 req-a5c095f7-6857-454c-ad8a-54e6791cdb8f tempest-SecurityGroupsTestJSON-1763653160 tempest-SecurityGroupsTestJSON-1763653160-project-member] Enqueued Resource ID: 0a7a78fa-fad0-458c-afc2-e1d98c9176ab with Priority: HIGHEST for action security_group_rules [ 863.353686] env[69232]: INFO networking_nsxv3.common.synchronization [req-4bca64db-856d-49e6-a40c-701f77c5db70 req-a5c095f7-6857-454c-ad8a-54e6791cdb8f tempest-SecurityGroupsTestJSON-1763653160 tempest-SecurityGroupsTestJSON-1763653160-project-member] Enqueued Resource ID: 0a7a78fa-fad0-458c-afc2-e1d98c9176ab with Priority: HIGHEST for action security_group_members [ 863.353822] env[69232]: INFO networking_nsxv3.common.synchronization [req-4bca64db-856d-49e6-a40c-701f77c5db70 req-a5c095f7-6857-454c-ad8a-54e6791cdb8f tempest-SecurityGroupsTestJSON-1763653160 tempest-SecurityGroupsTestJSON-1763653160-project-member] Enqueued Resource ID: 25f63f04-629a-4a58-8545-3a1625dc152b with Priority: HIGHEST for action security_group_rules [ 863.353952] env[69232]: INFO networking_nsxv3.common.synchronization [req-4bca64db-856d-49e6-a40c-701f77c5db70 req-a5c095f7-6857-454c-ad8a-54e6791cdb8f tempest-SecurityGroupsTestJSON-1763653160 tempest-SecurityGroupsTestJSON-1763653160-project-member] Enqueued Resource ID: 25f63f04-629a-4a58-8545-3a1625dc152b with Priority: HIGHEST for action security_group_members [ 863.354092] env[69232]: INFO networking_nsxv3.common.synchronization [req-4bca64db-856d-49e6-a40c-701f77c5db70 req-a5c095f7-6857-454c-ad8a-54e6791cdb8f tempest-SecurityGroupsTestJSON-1763653160 tempest-SecurityGroupsTestJSON-1763653160-project-member] Enqueued Resource ID: 9fc0b536-c43d-475e-8ce4-888e8fc85e0b with Priority: HIGHEST for action port [ 863.354663] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a7a78fa-fad0-458c-afc2-e1d98c9176ab with Priority: HIGHEST for action security_group_rules [ 863.354802] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25f63f04-629a-4a58-8545-3a1625dc152b with Priority: HIGHEST for action security_group_rules [ 863.354954] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9fc0b536-c43d-475e-8ce4-888e8fc85e0b with Priority: HIGHEST for action port [ 863.355085] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a7a78fa-fad0-458c-afc2-e1d98c9176ab with Priority: HIGHEST for action security_group_members [ 863.355085] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25f63f04-629a-4a58-8545-3a1625dc152b with Priority: HIGHEST for action security_group_members [ 863.356390] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0a7a78fa-fad0-458c-afc2-e1d98c9176ab taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.356529] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.356758] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.356963] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.357087] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0a7a78fa-fad0-458c-afc2-e1d98c9176ab',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.358061] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-25f63f04-629a-4a58-8545-3a1625dc152b taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.361536] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-25f63f04-629a-4a58-8545-3a1625dc152b" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.361616] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-25f63f04-629a-4a58-8545-3a1625dc152b" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.361955] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-25f63f04-629a-4a58-8545-3a1625dc152b" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.362066] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('25f63f04-629a-4a58-8545-3a1625dc152b',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.363477] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-9fc0b536-c43d-475e-8ce4-888e8fc85e0b taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.363477] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9fc0b536-c43d-475e-8ce4-888e8fc85e0b" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.363670] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9fc0b536-c43d-475e-8ce4-888e8fc85e0b" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.365356] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9fc0b536-c43d-475e-8ce4-888e8fc85e0b" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.365356] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9fc0b536-c43d-475e-8ce4-888e8fc85e0b',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.365571] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.365571] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.366115] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-25f63f04-629a-4a58-8545-3a1625dc152b taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.366115] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-25f63f04-629a-4a58-8545-3a1625dc152b" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.786488] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0a7a78fa-fad0-458c-afc2-e1d98c9176ab',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.787786] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('25f63f04-629a-4a58-8545-3a1625dc152b',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.869694] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.869869] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.870123] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-25f63f04-629a-4a58-8545-3a1625dc152b taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.870210] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-25f63f04-629a-4a58-8545-3a1625dc152b" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.870378] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9fc0b536-c43d-475e-8ce4-888e8fc85e0b with status ACTIVE [ 863.870552] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.870674] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.870738] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.871041] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.871137] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.871326] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.871430] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.871490] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.871671] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.871751] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.872445] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.872572] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.872637] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.872797] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.872877] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.872963] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9fc0b536-c43d-475e-8ce4-888e8fc85e0b is going to be updated. [ 863.900028] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.900028] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.900318] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.900350] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.901278] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.901278] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9fc0b536-c43d-475e-8ce4-888e8fc85e0b" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.289781] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('25f63f04-629a-4a58-8545-3a1625dc152b',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.290851] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0a7a78fa-fad0-458c-afc2-e1d98c9176ab',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.792982] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.793247] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.793383] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.793633] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.793730] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.793826] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 25f63f04-629a-4a58-8545-3a1625dc152b is going to be created. [ 864.795149] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.796122] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.796122] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.796122] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.796122] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.796122] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a7a78fa-fad0-458c-afc2-e1d98c9176ab is going to be updated. [ 864.823476] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.823476] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.823476] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.823752] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.823844] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.826214] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.827158] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.827276] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.828046] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.829047] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.840124] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a7a78fa-fad0-458c-afc2-e1d98c9176ab in Status: IN_PROGRESS for 2s [ 864.841353] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 25f63f04-629a-4a58-8545-3a1625dc152b in Status: UNINITIALIZED for 2s [ 866.814431] env[69232]: INFO networking_nsxv3.common.synchronization [req-1729fb91-4a59-4e4d-9728-b730afb8001e req-d0e3cdbf-47ee-4b92-b8be-8b936e68f257 tempest-ServerRescueTestJSON-1367609634 tempest-ServerRescueTestJSON-1367609634-project-member] Enqueued Resource ID: 15a3e0ef-3467-49d4-a8b2-072fce21b190 with Priority: HIGHEST for action security_group_members [ 866.814980] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15a3e0ef-3467-49d4-a8b2-072fce21b190 with Priority: HIGHEST for action security_group_members [ 866.815308] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-15a3e0ef-3467-49d4-a8b2-072fce21b190 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.815456] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15a3e0ef-3467-49d4-a8b2-072fce21b190" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.815519] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15a3e0ef-3467-49d4-a8b2-072fce21b190" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.815780] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15a3e0ef-3467-49d4-a8b2-072fce21b190" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.815933] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.817118] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.817217] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.817410] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.817502] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.817599] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('15a3e0ef-3467-49d4-a8b2-072fce21b190',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.921519] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a7a78fa-fad0-458c-afc2-e1d98c9176ab in Status: SUCCESS [ 866.921745] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.922659] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 25f63f04-629a-4a58-8545-3a1625dc152b in Status: SUCCESS [ 866.922833] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-25f63f04-629a-4a58-8545-3a1625dc152b" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.922989] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.923276] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.923472] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.923590] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.923656] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.923818] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.923899] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.923997] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0a7a78fa-fad0-458c-afc2-e1d98c9176ab',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.924823] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-25f63f04-629a-4a58-8545-3a1625dc152b" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.924989] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-25f63f04-629a-4a58-8545-3a1625dc152b" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.925160] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.925267] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.925332] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.925473] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.925551] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.925637] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('25f63f04-629a-4a58-8545-3a1625dc152b',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.161605] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock network-700 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.161605] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "network-700" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.161744] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "network-700" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.162173] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "network-700" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.162381] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.162548] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.162672] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.162890] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.163051] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.163306] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 867.163433] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] NeedRegenerationException {{(pid=69232) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 867.163590] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] no value, waiting for create lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 867.163710] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] value creation lock acquired {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 867.163830] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 867.163938] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Calling creation function for not-yet-present value {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 867.164090] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 867.183670] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 867.183670] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69232) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 867.183670] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Released creation lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 867.183870] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "network-700" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.184072] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock port-5cc67098-d14d-4381-bc5a-5b9ff0736cd2 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.184355] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "port-5cc67098-d14d-4381-bc5a-5b9ff0736cd2" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.184779] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "port-5cc67098-d14d-4381-bc5a-5b9ff0736cd2" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.184850] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "port-5cc67098-d14d-4381-bc5a-5b9ff0736cd2" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.184932] env[69232]: DEBUG networking_nsxv3.api.rpc [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5cc67098-d14d-4381-bc5a-5b9ff0736cd2',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.320954] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.320954] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.320954] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.321420] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.322600] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.322600] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.322600] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.322600] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.324588] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.324588] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.324588] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15a3e0ef-3467-49d4-a8b2-072fce21b190 already deleted. [ 867.324588] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15a3e0ef-3467-49d4-a8b2-072fce21b190" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.427087] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0a7a78fa-fad0-458c-afc2-e1d98c9176ab',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.429636] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('25f63f04-629a-4a58-8545-3a1625dc152b',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.688065] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.688309] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.688441] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.688720] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.688879] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.689112] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Segment Port 5cc67098-d14d-4381-bc5a-5b9ff0736cd2 not found, creating... [ 867.689300] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.689461] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.689581] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.689804] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.689945] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.690265] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.690435] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.690552] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.690749] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.690885] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.691118] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Resource: SegmentPort with ID: 5cc67098-d14d-4381-bc5a-5b9ff0736cd2 is going to be created. [ 867.711903] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.712233] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.712302] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.712571] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.712801] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.713046] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "port-5cc67098-d14d-4381-bc5a-5b9ff0736cd2" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.930358] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0a7a78fa-fad0-458c-afc2-e1d98c9176ab',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.933598] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('25f63f04-629a-4a58-8545-3a1625dc152b',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.428239] env[69232]: INFO networking_nsxv3.common.synchronization [req-1729fb91-4a59-4e4d-9728-b730afb8001e req-666e65c1-9471-4f7b-b0d2-fa74e2bd1fbd service nova] Enqueued Resource ID: 15a3e0ef-3467-49d4-a8b2-072fce21b190 with Priority: HIGHEST for action security_group_rules [ 868.428476] env[69232]: INFO networking_nsxv3.common.synchronization [req-1729fb91-4a59-4e4d-9728-b730afb8001e req-666e65c1-9471-4f7b-b0d2-fa74e2bd1fbd service nova] Enqueued Resource ID: 15a3e0ef-3467-49d4-a8b2-072fce21b190 with Priority: HIGHEST for action security_group_members [ 868.428670] env[69232]: INFO networking_nsxv3.common.synchronization [req-1729fb91-4a59-4e4d-9728-b730afb8001e req-666e65c1-9471-4f7b-b0d2-fa74e2bd1fbd service nova] Enqueued Resource ID: 5cc67098-d14d-4381-bc5a-5b9ff0736cd2 with Priority: HIGHEST for action port [ 868.429580] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15a3e0ef-3467-49d4-a8b2-072fce21b190 with Priority: HIGHEST for action security_group_rules [ 868.429580] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15a3e0ef-3467-49d4-a8b2-072fce21b190 with Priority: HIGHEST for action security_group_members [ 868.429580] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5cc67098-d14d-4381-bc5a-5b9ff0736cd2 with Priority: HIGHEST for action port [ 868.429952] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-15a3e0ef-3467-49d4-a8b2-072fce21b190 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.430124] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-15a3e0ef-3467-49d4-a8b2-072fce21b190" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.430224] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-15a3e0ef-3467-49d4-a8b2-072fce21b190" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.430587] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-15a3e0ef-3467-49d4-a8b2-072fce21b190" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.430647] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('15a3e0ef-3467-49d4-a8b2-072fce21b190',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.431706] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-15a3e0ef-3467-49d4-a8b2-072fce21b190 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.431855] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15a3e0ef-3467-49d4-a8b2-072fce21b190" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.431943] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15a3e0ef-3467-49d4-a8b2-072fce21b190" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.432202] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15a3e0ef-3467-49d4-a8b2-072fce21b190" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.432406] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.432536] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.432627] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.432824] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.432948] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.433094] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('15a3e0ef-3467-49d4-a8b2-072fce21b190',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.434033] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-5cc67098-d14d-4381-bc5a-5b9ff0736cd2 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.434359] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5cc67098-d14d-4381-bc5a-5b9ff0736cd2" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.434359] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5cc67098-d14d-4381-bc5a-5b9ff0736cd2" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.434536] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5cc67098-d14d-4381-bc5a-5b9ff0736cd2" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.434647] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5cc67098-d14d-4381-bc5a-5b9ff0736cd2',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.437577] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.440084] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.440084] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.440084] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.440084] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.440084] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a7a78fa-fad0-458c-afc2-e1d98c9176ab is going to be updated. [ 868.440084] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.440084] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.440377] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.440411] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.440552] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.440677] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 25f63f04-629a-4a58-8545-3a1625dc152b is going to be updated. [ 868.469788] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.470109] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.470109] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.470266] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.470409] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.472166] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.472332] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.472406] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.472539] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.472669] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.482338] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 25f63f04-629a-4a58-8545-3a1625dc152b in Status: IN_PROGRESS for 2s [ 868.482938] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a7a78fa-fad0-458c-afc2-e1d98c9176ab in Status: IN_PROGRESS for 2s [ 868.678289] env[69232]: INFO networking_nsxv3.common.synchronization [req-c253c1b1-394d-4fe7-a1c8-96b16f3e095b req-1025442b-ab6d-4036-bcec-72fa5325b441 tempest-MigrationsAdminTest-606964981 tempest-MigrationsAdminTest-606964981-project-member] Enqueued Resource ID: 531d0f92-2e98-47df-b32d-d49e1d2f34c1 with Priority: HIGHEST for action security_group_members [ 868.678289] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 531d0f92-2e98-47df-b32d-d49e1d2f34c1 with Priority: HIGHEST for action security_group_members [ 868.678289] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-531d0f92-2e98-47df-b32d-d49e1d2f34c1 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.678289] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-531d0f92-2e98-47df-b32d-d49e1d2f34c1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.678289] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-531d0f92-2e98-47df-b32d-d49e1d2f34c1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.678289] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-531d0f92-2e98-47df-b32d-d49e1d2f34c1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.678289] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.678289] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.678289] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.679412] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.679654] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.681047] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('531d0f92-2e98-47df-b32d-d49e1d2f34c1',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.937402] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('15a3e0ef-3467-49d4-a8b2-072fce21b190',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.938593] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-15a3e0ef-3467-49d4-a8b2-072fce21b190 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.938593] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15a3e0ef-3467-49d4-a8b2-072fce21b190" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.943214] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5cc67098-d14d-4381-bc5a-5b9ff0736cd2 with status ACTIVE [ 868.943456] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.943592] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.943660] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.943881] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.944014] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.944174] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.944274] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.944337] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.944498] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.944578] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.945296] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.945296] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.945296] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.945296] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.945296] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.945296] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5cc67098-d14d-4381-bc5a-5b9ff0736cd2 is going to be updated. [ 868.970867] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.971015] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.971081] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.971721] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.971721] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.971721] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5cc67098-d14d-4381-bc5a-5b9ff0736cd2" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.186370] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('531d0f92-2e98-47df-b32d-d49e1d2f34c1',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.439838] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('15a3e0ef-3467-49d4-a8b2-072fce21b190',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.688882] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('531d0f92-2e98-47df-b32d-d49e1d2f34c1',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.942440] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.942701] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.942701] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.943020] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.943020] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.943020] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15a3e0ef-3467-49d4-a8b2-072fce21b190 is going to be created. [ 869.970813] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.970813] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.970813] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.971029] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.972028] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.982520] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15a3e0ef-3467-49d4-a8b2-072fce21b190 in Status: UNINITIALIZED for 2s [ 870.191738] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.191911] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.191975] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.192265] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.192328] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.192426] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 531d0f92-2e98-47df-b32d-d49e1d2f34c1 is going to be updated. [ 870.248673] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.248885] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.248946] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.249176] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.249338] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.259795] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 531d0f92-2e98-47df-b32d-d49e1d2f34c1 in Status: IN_PROGRESS for 2s [ 870.495021] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 25f63f04-629a-4a58-8545-3a1625dc152b in Status: SUCCESS [ 870.495021] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-25f63f04-629a-4a58-8545-3a1625dc152b" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.495021] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-25f63f04-629a-4a58-8545-3a1625dc152b" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.495021] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-25f63f04-629a-4a58-8545-3a1625dc152b" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.495021] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.495021] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.495021] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.495021] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.495021] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.495021] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-25f63f04-629a-4a58-8545-3a1625dc152b" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.495021] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('25f63f04-629a-4a58-8545-3a1625dc152b',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.496397] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a7a78fa-fad0-458c-afc2-e1d98c9176ab in Status: SUCCESS [ 870.497096] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.497359] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.497656] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.499750] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.499750] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.499750] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.499750] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.499750] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.499750] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.499750] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0a7a78fa-fad0-458c-afc2-e1d98c9176ab',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.625374] env[69232]: INFO networking_nsxv3.common.synchronization [req-ce54f603-9b8c-4a76-869c-3fd2873edf6b req-ce936dc8-95b3-4cf6-b6a6-31ba284111cc tempest-SecurityGroupsTestJSON-1763653160 tempest-SecurityGroupsTestJSON-1763653160-project-member] Enqueued Resource ID: 17506520-5a00-46ad-a9e2-15d389782411 with Priority: HIGHEST for action security_group_members [ 870.625374] env[69232]: INFO networking_nsxv3.common.synchronization [req-ce54f603-9b8c-4a76-869c-3fd2873edf6b req-ce936dc8-95b3-4cf6-b6a6-31ba284111cc tempest-SecurityGroupsTestJSON-1763653160 tempest-SecurityGroupsTestJSON-1763653160-project-member] Enqueued Resource ID: 0a7a78fa-fad0-458c-afc2-e1d98c9176ab with Priority: HIGHEST for action security_group_members [ 870.625374] env[69232]: INFO networking_nsxv3.common.synchronization [req-ce54f603-9b8c-4a76-869c-3fd2873edf6b req-ce936dc8-95b3-4cf6-b6a6-31ba284111cc tempest-SecurityGroupsTestJSON-1763653160 tempest-SecurityGroupsTestJSON-1763653160-project-member] Enqueued Resource ID: 25f63f04-629a-4a58-8545-3a1625dc152b with Priority: HIGHEST for action security_group_members [ 870.625374] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17506520-5a00-46ad-a9e2-15d389782411 with Priority: HIGHEST for action security_group_members [ 870.625374] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a7a78fa-fad0-458c-afc2-e1d98c9176ab with Priority: HIGHEST for action security_group_members [ 870.625374] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25f63f04-629a-4a58-8545-3a1625dc152b with Priority: HIGHEST for action security_group_members [ 870.627240] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-17506520-5a00-46ad-a9e2-15d389782411 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.627552] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-17506520-5a00-46ad-a9e2-15d389782411" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.627918] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-17506520-5a00-46ad-a9e2-15d389782411" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.631024] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-17506520-5a00-46ad-a9e2-15d389782411" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.631024] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.631024] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.631024] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.631024] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.631024] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.631024] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('17506520-5a00-46ad-a9e2-15d389782411',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.631024] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.631024] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.631024] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.631024] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.631024] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.631024] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.631024] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.631024] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.631024] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.631024] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0a7a78fa-fad0-458c-afc2-e1d98c9176ab',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.632597] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-25f63f04-629a-4a58-8545-3a1625dc152b taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.635975] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-25f63f04-629a-4a58-8545-3a1625dc152b" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.635975] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-25f63f04-629a-4a58-8545-3a1625dc152b" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.635975] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-25f63f04-629a-4a58-8545-3a1625dc152b" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.635975] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.635975] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.635975] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.635975] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.635975] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.635975] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('25f63f04-629a-4a58-8545-3a1625dc152b',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.670362] env[69232]: INFO networking_nsxv3.common.synchronization [req-5f932059-b2b6-41df-a2d7-4d6a28b11e61 req-50d32697-e087-43ea-9f9d-92337f319e80 tempest-VolumesAdminNegativeTest-609403025 tempest-VolumesAdminNegativeTest-609403025-project-member] Enqueued Resource ID: 453650db-0c42-4224-8f26-d113b3aaa020 with Priority: HIGHEST for action security_group_members [ 870.672071] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 453650db-0c42-4224-8f26-d113b3aaa020 with Priority: HIGHEST for action security_group_members [ 870.672891] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-453650db-0c42-4224-8f26-d113b3aaa020 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.673035] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-453650db-0c42-4224-8f26-d113b3aaa020" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.673101] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-453650db-0c42-4224-8f26-d113b3aaa020" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.673322] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-453650db-0c42-4224-8f26-d113b3aaa020" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.673474] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.673569] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.673630] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.673778] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.673855] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.673950] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('453650db-0c42-4224-8f26-d113b3aaa020',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.735644] env[69232]: INFO networking_nsxv3.common.synchronization [req-ce54f603-9b8c-4a76-869c-3fd2873edf6b req-ce936dc8-95b3-4cf6-b6a6-31ba284111cc tempest-SecurityGroupsTestJSON-1763653160 tempest-SecurityGroupsTestJSON-1763653160-project-member] Enqueued Resource ID: 0a7a78fa-fad0-458c-afc2-e1d98c9176ab with Priority: HIGHEST for action security_group_rules [ 870.735867] env[69232]: INFO networking_nsxv3.common.synchronization [req-ce54f603-9b8c-4a76-869c-3fd2873edf6b req-ce936dc8-95b3-4cf6-b6a6-31ba284111cc tempest-SecurityGroupsTestJSON-1763653160 tempest-SecurityGroupsTestJSON-1763653160-project-member] Enqueued Resource ID: 0a7a78fa-fad0-458c-afc2-e1d98c9176ab with Priority: HIGHEST for action security_group_members [ 870.737163] env[69232]: INFO networking_nsxv3.common.synchronization [req-ce54f603-9b8c-4a76-869c-3fd2873edf6b req-ce936dc8-95b3-4cf6-b6a6-31ba284111cc tempest-SecurityGroupsTestJSON-1763653160 tempest-SecurityGroupsTestJSON-1763653160-project-member] Enqueued Resource ID: 17506520-5a00-46ad-a9e2-15d389782411 with Priority: HIGHEST for action security_group_rules [ 870.737374] env[69232]: INFO networking_nsxv3.common.synchronization [req-ce54f603-9b8c-4a76-869c-3fd2873edf6b req-ce936dc8-95b3-4cf6-b6a6-31ba284111cc tempest-SecurityGroupsTestJSON-1763653160 tempest-SecurityGroupsTestJSON-1763653160-project-member] Enqueued Resource ID: 17506520-5a00-46ad-a9e2-15d389782411 with Priority: HIGHEST for action security_group_members [ 870.737550] env[69232]: INFO networking_nsxv3.common.synchronization [req-ce54f603-9b8c-4a76-869c-3fd2873edf6b req-ce936dc8-95b3-4cf6-b6a6-31ba284111cc tempest-SecurityGroupsTestJSON-1763653160 tempest-SecurityGroupsTestJSON-1763653160-project-member] Enqueued Resource ID: 25f63f04-629a-4a58-8545-3a1625dc152b with Priority: HIGHEST for action security_group_rules [ 870.737691] env[69232]: INFO networking_nsxv3.common.synchronization [req-ce54f603-9b8c-4a76-869c-3fd2873edf6b req-ce936dc8-95b3-4cf6-b6a6-31ba284111cc tempest-SecurityGroupsTestJSON-1763653160 tempest-SecurityGroupsTestJSON-1763653160-project-member] Enqueued Resource ID: 25f63f04-629a-4a58-8545-3a1625dc152b with Priority: HIGHEST for action security_group_members [ 870.737825] env[69232]: INFO networking_nsxv3.common.synchronization [req-ce54f603-9b8c-4a76-869c-3fd2873edf6b req-ce936dc8-95b3-4cf6-b6a6-31ba284111cc tempest-SecurityGroupsTestJSON-1763653160 tempest-SecurityGroupsTestJSON-1763653160-project-member] Enqueued Resource ID: 9fc0b536-c43d-475e-8ce4-888e8fc85e0b with Priority: HIGHEST for action port [ 870.738444] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a7a78fa-fad0-458c-afc2-e1d98c9176ab with Priority: HIGHEST for action security_group_rules [ 870.738611] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17506520-5a00-46ad-a9e2-15d389782411 with Priority: HIGHEST for action security_group_rules [ 870.738682] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25f63f04-629a-4a58-8545-3a1625dc152b with Priority: HIGHEST for action security_group_members [ 870.738774] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9fc0b536-c43d-475e-8ce4-888e8fc85e0b with Priority: HIGHEST for action port [ 870.738876] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25f63f04-629a-4a58-8545-3a1625dc152b with Priority: HIGHEST for action security_group_rules [ 870.738960] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a7a78fa-fad0-458c-afc2-e1d98c9176ab with Priority: HIGHEST for action security_group_members [ 870.739054] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17506520-5a00-46ad-a9e2-15d389782411 with Priority: HIGHEST for action security_group_members [ 870.739748] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0a7a78fa-fad0-458c-afc2-e1d98c9176ab taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.739748] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.739923] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-17506520-5a00-46ad-a9e2-15d389782411 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.740040] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-17506520-5a00-46ad-a9e2-15d389782411" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.740108] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-17506520-5a00-46ad-a9e2-15d389782411" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.740362] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-17506520-5a00-46ad-a9e2-15d389782411" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.740445] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('17506520-5a00-46ad-a9e2-15d389782411',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.741327] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-25f63f04-629a-4a58-8545-3a1625dc152b taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.741425] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-25f63f04-629a-4a58-8545-3a1625dc152b" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.741632] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-9fc0b536-c43d-475e-8ce4-888e8fc85e0b taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.741712] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9fc0b536-c43d-475e-8ce4-888e8fc85e0b" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.741776] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9fc0b536-c43d-475e-8ce4-888e8fc85e0b" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.741973] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9fc0b536-c43d-475e-8ce4-888e8fc85e0b" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.742276] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9fc0b536-c43d-475e-8ce4-888e8fc85e0b',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.743398] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-25f63f04-629a-4a58-8545-3a1625dc152b taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.743528] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-25f63f04-629a-4a58-8545-3a1625dc152b" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.743749] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.743870] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.744095] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-17506520-5a00-46ad-a9e2-15d389782411 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.744201] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-17506520-5a00-46ad-a9e2-15d389782411" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.000249] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('25f63f04-629a-4a58-8545-3a1625dc152b',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.001503] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.001604] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.136877] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('17506520-5a00-46ad-a9e2-15d389782411',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.137522] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0a7a78fa-fad0-458c-afc2-e1d98c9176ab',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.138443] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('25f63f04-629a-4a58-8545-3a1625dc152b',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.176932] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.177184] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.177305] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.177456] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.177573] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.177850] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.178048] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.178179] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.178386] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.178476] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.178584] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 453650db-0c42-4224-8f26-d113b3aaa020 is going to be updated. [ 871.218180] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.218347] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.218406] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.218594] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.218731] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.229024] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 453650db-0c42-4224-8f26-d113b3aaa020 in Status: IN_PROGRESS for 2s [ 871.245905] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-17506520-5a00-46ad-a9e2-15d389782411 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.246069] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-17506520-5a00-46ad-a9e2-15d389782411" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.246282] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9fc0b536-c43d-475e-8ce4-888e8fc85e0b with status ACTIVE [ 871.246457] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.246569] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.246622] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.246909] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.247046] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.247456] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.247456] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.247456] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.247726] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.247726] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.247819] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.247913] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.247970] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.248461] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.248461] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.248461] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9fc0b536-c43d-475e-8ce4-888e8fc85e0b is going to be updated. [ 871.270368] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.270650] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.270650] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.270818] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.271113] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.271290] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9fc0b536-c43d-475e-8ce4-888e8fc85e0b" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.504483] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 25f63f04-629a-4a58-8545-3a1625dc152b: rpc.has_security_group_logging(os_id): False [ 871.525501] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.525644] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.525712] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.525917] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.525999] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.526251] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.526332] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.526332] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.526332] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.526662] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.526704] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 25f63f04-629a-4a58-8545-3a1625dc152b is going to be created. [ 871.582951] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.583215] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.583325] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.584956] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.585258] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.600199] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 25f63f04-629a-4a58-8545-3a1625dc152b in Status: IN_PROGRESS for 2s [ 871.638824] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('17506520-5a00-46ad-a9e2-15d389782411',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.639854] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0a7a78fa-fad0-458c-afc2-e1d98c9176ab',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.644339] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('25f63f04-629a-4a58-8545-3a1625dc152b',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.994162] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15a3e0ef-3467-49d4-a8b2-072fce21b190 in Status: SUCCESS [ 871.994162] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15a3e0ef-3467-49d4-a8b2-072fce21b190" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.994162] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15a3e0ef-3467-49d4-a8b2-072fce21b190" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.994162] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15a3e0ef-3467-49d4-a8b2-072fce21b190" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.994162] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.994162] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.994381] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.994456] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.994529] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.994615] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15a3e0ef-3467-49d4-a8b2-072fce21b190" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.994708] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('15a3e0ef-3467-49d4-a8b2-072fce21b190',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.142484] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.142957] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.142957] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.142957] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.143072] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.143110] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 17506520-5a00-46ad-a9e2-15d389782411 is going to be created. [ 872.146018] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.146018] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.146018] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.146018] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.146018] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.146018] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a7a78fa-fad0-458c-afc2-e1d98c9176ab is going to be updated. [ 872.151571] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.151702] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.152001] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.152001] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.152830] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.152830] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 25f63f04-629a-4a58-8545-3a1625dc152b is going to be updated. [ 872.204023] env[69232]: INFO networking_nsxv3.common.synchronization [req-cf1db6a3-840b-4e7f-ba3c-661a57a12d4c req-38173d52-5f83-44bf-ada6-ea1bf63b98a5 tempest-ImagesOneServerNegativeTestJSON-501782696 tempest-ImagesOneServerNegativeTestJSON-501782696-project-member] Enqueued Resource ID: 6e7bf0fa-24cf-40f7-ac38-1adabda5207c with Priority: HIGHEST for action security_group_members [ 872.204681] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e7bf0fa-24cf-40f7-ac38-1adabda5207c with Priority: HIGHEST for action security_group_members [ 872.205076] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e7bf0fa-24cf-40f7-ac38-1adabda5207c taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.205236] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e7bf0fa-24cf-40f7-ac38-1adabda5207c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.205306] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e7bf0fa-24cf-40f7-ac38-1adabda5207c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.205566] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e7bf0fa-24cf-40f7-ac38-1adabda5207c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.205770] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.205920] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.205993] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.206186] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.206276] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.206372] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6e7bf0fa-24cf-40f7-ac38-1adabda5207c',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.216525] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.216749] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.216880] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.217081] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.217322] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.223598] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.223598] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.223598] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.224485] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.224485] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.231511] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.231658] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.231704] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.231901] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.233116] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.234570] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 17506520-5a00-46ad-a9e2-15d389782411 in Status: UNINITIALIZED for 2s [ 872.237116] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 25f63f04-629a-4a58-8545-3a1625dc152b in Status: IN_PROGRESS for 2s [ 872.246306] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a7a78fa-fad0-458c-afc2-e1d98c9176ab in Status: IN_PROGRESS for 2s [ 872.273227] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 531d0f92-2e98-47df-b32d-d49e1d2f34c1 in Status: SUCCESS [ 872.274421] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-531d0f92-2e98-47df-b32d-d49e1d2f34c1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.499751] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-15a3e0ef-3467-49d4-a8b2-072fce21b190 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.500447] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15a3e0ef-3467-49d4-a8b2-072fce21b190" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.500551] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15a3e0ef-3467-49d4-a8b2-072fce21b190" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.500830] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15a3e0ef-3467-49d4-a8b2-072fce21b190" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.501069] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.501206] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.501253] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.501393] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.501478] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.501580] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15a3e0ef-3467-49d4-a8b2-072fce21b190" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.501729] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-15a3e0ef-3467-49d4-a8b2-072fce21b190 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.501824] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15a3e0ef-3467-49d4-a8b2-072fce21b190" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.501886] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15a3e0ef-3467-49d4-a8b2-072fce21b190" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.502076] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15a3e0ef-3467-49d4-a8b2-072fce21b190" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.502221] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.502319] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.502384] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.502525] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.502601] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.502682] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15a3e0ef-3467-49d4-a8b2-072fce21b190" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.502771] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('15a3e0ef-3467-49d4-a8b2-072fce21b190',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.696616] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock network-821 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.696813] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "network-821" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.696938] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "network-821" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.697277] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "network-821" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.697541] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.697718] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.697842] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.698094] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.698241] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.698452] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 872.698566] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] NeedRegenerationException {{(pid=69232) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 872.698688] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] no value, waiting for create lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 872.698802] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] value creation lock acquired {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 872.698944] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 872.699084] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Calling creation function for not-yet-present value {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 872.699223] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 872.709615] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.709615] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.709615] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.709865] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.710197] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.710197] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.710308] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.710361] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.710485] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.710560] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.710646] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e7bf0fa-24cf-40f7-ac38-1adabda5207c is going to be deleted. [ 872.719759] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 872.720126] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69232) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 872.720354] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Released creation lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 872.720659] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "network-821" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.721157] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock port-3f55ad75-ab05-44af-a4d0-30ca7e2062b0 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.721451] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "port-3f55ad75-ab05-44af-a4d0-30ca7e2062b0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.721692] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "port-3f55ad75-ab05-44af-a4d0-30ca7e2062b0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.722571] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "port-3f55ad75-ab05-44af-a4d0-30ca7e2062b0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.722699] env[69232]: DEBUG networking_nsxv3.api.rpc [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3f55ad75-ab05-44af-a4d0-30ca7e2062b0',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.756740] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.756740] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.756740] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.756740] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.756740] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.757108] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e7bf0fa-24cf-40f7-ac38-1adabda5207c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.007614] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 15a3e0ef-3467-49d4-a8b2-072fce21b190: rpc.has_security_group_logging(os_id): False [ 873.026169] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.026321] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.026394] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.026607] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.026694] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.026899] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.027020] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.027076] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.027233] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.027316] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.027512] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.027606] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.027675] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.027822] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.027883] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.028090] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.028199] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.028259] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.028395] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.028466] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.028547] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 15a3e0ef-3467-49d4-a8b2-072fce21b190 is going to be created. [ 873.100941] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.101194] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.101361] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.101604] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.101887] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.117785] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 15a3e0ef-3467-49d4-a8b2-072fce21b190 in Status: IN_PROGRESS for 2s [ 873.230477] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.230477] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.230477] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.230477] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.230477] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.230477] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Segment Port 3f55ad75-ab05-44af-a4d0-30ca7e2062b0 not found, creating... [ 873.230477] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.230477] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.230477] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.230477] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.230477] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.231101] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.232079] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.233044] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.236057] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.236057] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.236057] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Resource: SegmentPort with ID: 3f55ad75-ab05-44af-a4d0-30ca7e2062b0 is going to be created. [ 873.257840] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 453650db-0c42-4224-8f26-d113b3aaa020 in Status: SUCCESS [ 873.258036] env[69232]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 453650db-0c42-4224-8f26-d113b3aaa020 deletion is rescheduled due to dependency. [ 873.258166] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-453650db-0c42-4224-8f26-d113b3aaa020" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.275456] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.275640] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.275724] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.276084] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.276356] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.276648] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "port-3f55ad75-ab05-44af-a4d0-30ca7e2062b0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.417580] env[69232]: INFO networking_nsxv3.common.synchronization [req-a6484093-d49f-4116-8082-b6032bcd5b72 req-63ab81af-77f6-43e9-9e70-75577775e8b8 tempest-SecurityGroupsTestJSON-1763653160 tempest-SecurityGroupsTestJSON-1763653160-project-member] Enqueued Resource ID: 0a7a78fa-fad0-458c-afc2-e1d98c9176ab with Priority: HIGHEST for action security_group_members [ 873.417580] env[69232]: INFO networking_nsxv3.common.synchronization [req-a6484093-d49f-4116-8082-b6032bcd5b72 req-63ab81af-77f6-43e9-9e70-75577775e8b8 tempest-SecurityGroupsTestJSON-1763653160 tempest-SecurityGroupsTestJSON-1763653160-project-member] Enqueued Resource ID: 17506520-5a00-46ad-a9e2-15d389782411 with Priority: HIGHEST for action security_group_members [ 873.417580] env[69232]: INFO networking_nsxv3.common.synchronization [req-a6484093-d49f-4116-8082-b6032bcd5b72 req-63ab81af-77f6-43e9-9e70-75577775e8b8 tempest-SecurityGroupsTestJSON-1763653160 tempest-SecurityGroupsTestJSON-1763653160-project-member] Enqueued Resource ID: 25f63f04-629a-4a58-8545-3a1625dc152b with Priority: HIGHEST for action security_group_members [ 873.417580] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a7a78fa-fad0-458c-afc2-e1d98c9176ab with Priority: HIGHEST for action security_group_members [ 873.417580] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17506520-5a00-46ad-a9e2-15d389782411 with Priority: HIGHEST for action security_group_members [ 873.417580] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25f63f04-629a-4a58-8545-3a1625dc152b with Priority: HIGHEST for action security_group_members [ 873.418214] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.418495] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.418849] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-17506520-5a00-46ad-a9e2-15d389782411 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.419135] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-17506520-5a00-46ad-a9e2-15d389782411" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.419511] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-25f63f04-629a-4a58-8545-3a1625dc152b taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.419718] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-25f63f04-629a-4a58-8545-3a1625dc152b" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.613508] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 25f63f04-629a-4a58-8545-3a1625dc152b in Status: SUCCESS [ 873.613508] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-25f63f04-629a-4a58-8545-3a1625dc152b" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.613738] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-25f63f04-629a-4a58-8545-3a1625dc152b" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.614961] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-25f63f04-629a-4a58-8545-3a1625dc152b" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.614961] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('25f63f04-629a-4a58-8545-3a1625dc152b',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.006440] env[69232]: INFO networking_nsxv3.common.synchronization [req-cf1db6a3-840b-4e7f-ba3c-661a57a12d4c req-db02531b-6d02-45ce-b97c-82a47b49b3ad service nova] Enqueued Resource ID: 6e7bf0fa-24cf-40f7-ac38-1adabda5207c with Priority: HIGHEST for action security_group_rules [ 874.006575] env[69232]: INFO networking_nsxv3.common.synchronization [req-cf1db6a3-840b-4e7f-ba3c-661a57a12d4c req-db02531b-6d02-45ce-b97c-82a47b49b3ad service nova] Enqueued Resource ID: 6e7bf0fa-24cf-40f7-ac38-1adabda5207c with Priority: HIGHEST for action security_group_members [ 874.006714] env[69232]: INFO networking_nsxv3.common.synchronization [req-cf1db6a3-840b-4e7f-ba3c-661a57a12d4c req-db02531b-6d02-45ce-b97c-82a47b49b3ad service nova] Enqueued Resource ID: 3f55ad75-ab05-44af-a4d0-30ca7e2062b0 with Priority: HIGHEST for action port [ 874.006943] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e7bf0fa-24cf-40f7-ac38-1adabda5207c with Priority: HIGHEST for action security_group_rules [ 874.007199] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e7bf0fa-24cf-40f7-ac38-1adabda5207c with Priority: HIGHEST for action security_group_members [ 874.007199] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f55ad75-ab05-44af-a4d0-30ca7e2062b0 with Priority: HIGHEST for action port [ 874.007737] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6e7bf0fa-24cf-40f7-ac38-1adabda5207c taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.007970] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6e7bf0fa-24cf-40f7-ac38-1adabda5207c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.007970] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6e7bf0fa-24cf-40f7-ac38-1adabda5207c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.009333] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6e7bf0fa-24cf-40f7-ac38-1adabda5207c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.009459] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6e7bf0fa-24cf-40f7-ac38-1adabda5207c',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.010380] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e7bf0fa-24cf-40f7-ac38-1adabda5207c taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.010498] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e7bf0fa-24cf-40f7-ac38-1adabda5207c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.010578] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e7bf0fa-24cf-40f7-ac38-1adabda5207c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.010770] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e7bf0fa-24cf-40f7-ac38-1adabda5207c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.010914] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.011071] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.011135] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.011286] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.011375] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.011467] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6e7bf0fa-24cf-40f7-ac38-1adabda5207c',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.012732] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-3f55ad75-ab05-44af-a4d0-30ca7e2062b0 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.012732] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3f55ad75-ab05-44af-a4d0-30ca7e2062b0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.012732] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3f55ad75-ab05-44af-a4d0-30ca7e2062b0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.012887] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3f55ad75-ab05-44af-a4d0-30ca7e2062b0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.012887] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3f55ad75-ab05-44af-a4d0-30ca7e2062b0',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.157284] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.157441] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.157494] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.157726] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.157904] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.158167] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 25f63f04-629a-4a58-8545-3a1625dc152b is going to be deleted. [ 874.220771] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.220922] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.221141] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.221409] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.221716] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.221716] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-25f63f04-629a-4a58-8545-3a1625dc152b" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.247189] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 17506520-5a00-46ad-a9e2-15d389782411 in Status: SUCCESS [ 874.247521] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-17506520-5a00-46ad-a9e2-15d389782411" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.248596] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-17506520-5a00-46ad-a9e2-15d389782411" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.248829] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-17506520-5a00-46ad-a9e2-15d389782411" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.249028] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.249152] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.249208] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.249419] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.249536] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.249690] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('17506520-5a00-46ad-a9e2-15d389782411',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.254055] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 25f63f04-629a-4a58-8545-3a1625dc152b in Status: SUCCESS [ 874.254055] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-25f63f04-629a-4a58-8545-3a1625dc152b" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.254055] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-25f63f04-629a-4a58-8545-3a1625dc152b" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.254055] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-25f63f04-629a-4a58-8545-3a1625dc152b" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.254055] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.254055] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.254055] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.254055] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.254055] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.254055] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('25f63f04-629a-4a58-8545-3a1625dc152b',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.261815] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a7a78fa-fad0-458c-afc2-e1d98c9176ab in Status: SUCCESS [ 874.262036] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.262493] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.262703] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.262881] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.263129] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.263129] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.263223] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.263290] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.263629] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0a7a78fa-fad0-458c-afc2-e1d98c9176ab',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.514112] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e7bf0fa-24cf-40f7-ac38-1adabda5207c taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.514293] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e7bf0fa-24cf-40f7-ac38-1adabda5207c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.514642] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6e7bf0fa-24cf-40f7-ac38-1adabda5207c',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.515683] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3f55ad75-ab05-44af-a4d0-30ca7e2062b0 with status ACTIVE [ 874.515812] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.516383] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.516383] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.516383] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.516383] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.516547] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.516640] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.516713] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.517304] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.517373] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.518139] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.518139] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.518139] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.518139] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.518139] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.518139] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3f55ad75-ab05-44af-a4d0-30ca7e2062b0 is going to be updated. [ 874.543031] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.543171] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.543171] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.543420] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.544057] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.544057] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3f55ad75-ab05-44af-a4d0-30ca7e2062b0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.754488] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.754645] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.754726] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.754933] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.754989] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.755192] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.755288] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.755349] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.755502] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.755578] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.755674] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 17506520-5a00-46ad-a9e2-15d389782411 is going to be deleted. [ 874.756775] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.756903] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.756950] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.757481] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.757573] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.757748] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.757847] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.757918] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.758076] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.758219] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.758270] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 25f63f04-629a-4a58-8545-3a1625dc152b is going to be deleted. [ 874.768351] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0a7a78fa-fad0-458c-afc2-e1d98c9176ab',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.793165] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.793345] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.793400] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.793591] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.793672] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.794607] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-17506520-5a00-46ad-a9e2-15d389782411" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.794607] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-17506520-5a00-46ad-a9e2-15d389782411" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.794607] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-17506520-5a00-46ad-a9e2-15d389782411" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.794607] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.794838] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.794838] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.794906] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.795143] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.795143] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('17506520-5a00-46ad-a9e2-15d389782411',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.796688] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.796818] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.796885] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.797247] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.797247] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.797247] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-25f63f04-629a-4a58-8545-3a1625dc152b" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.797415] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-25f63f04-629a-4a58-8545-3a1625dc152b" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.797535] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-25f63f04-629a-4a58-8545-3a1625dc152b" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.797729] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.797862] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.797960] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.798152] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.798262] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.798380] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('25f63f04-629a-4a58-8545-3a1625dc152b',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.019880] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6e7bf0fa-24cf-40f7-ac38-1adabda5207c',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.140665] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 15a3e0ef-3467-49d4-a8b2-072fce21b190 in Status: SUCCESS [ 875.140905] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-15a3e0ef-3467-49d4-a8b2-072fce21b190" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.269952] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0a7a78fa-fad0-458c-afc2-e1d98c9176ab',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.300504] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.300693] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.300733] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.300927] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.301119] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.301332] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.301463] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.301532] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.301699] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.301777] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.301864] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 17506520-5a00-46ad-a9e2-15d389782411 already deleted. [ 875.301943] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-17506520-5a00-46ad-a9e2-15d389782411" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.302062] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('17506520-5a00-46ad-a9e2-15d389782411',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.303121] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.303237] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.303237] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.303398] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.303480] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.303650] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.303746] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.303809] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.303953] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.304091] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.304122] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 25f63f04-629a-4a58-8545-3a1625dc152b already deleted. [ 875.304210] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-25f63f04-629a-4a58-8545-3a1625dc152b" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.304613] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-17506520-5a00-46ad-a9e2-15d389782411" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.304771] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-17506520-5a00-46ad-a9e2-15d389782411" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.304918] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.305021] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.305126] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.305218] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.305295] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.305382] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('17506520-5a00-46ad-a9e2-15d389782411',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.524514] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.524680] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.524755] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.525346] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.525346] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.525346] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e7bf0fa-24cf-40f7-ac38-1adabda5207c is going to be created. [ 875.551459] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.551617] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.551687] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.551903] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.553027] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.562151] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e7bf0fa-24cf-40f7-ac38-1adabda5207c in Status: UNINITIALIZED for 2s [ 875.772733] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.774118] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.774118] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.774118] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.774118] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.774118] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a7a78fa-fad0-458c-afc2-e1d98c9176ab is going to be updated. [ 875.805264] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('17506520-5a00-46ad-a9e2-15d389782411',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.810926] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.811142] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.811227] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.811452] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.811544] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.811811] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.811965] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.812076] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.812330] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.812402] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.812527] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 17506520-5a00-46ad-a9e2-15d389782411 already deleted. [ 875.812642] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-17506520-5a00-46ad-a9e2-15d389782411" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.813945] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.814484] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.814658] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.814787] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.814962] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.826362] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a7a78fa-fad0-458c-afc2-e1d98c9176ab in Status: IN_PROGRESS for 2s [ 876.308517] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 17506520-5a00-46ad-a9e2-15d389782411: rpc.has_security_group_logging(os_id): False [ 876.328903] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.329238] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.329238] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.329391] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.329487] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.330055] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.330055] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.330055] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.330055] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.330400] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.330400] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 17506520-5a00-46ad-a9e2-15d389782411 is going to be created. [ 876.356937] env[69232]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/17506520-5a00-46ad-a9e2-15d389782411], does not exist path=[/infra/domains/default/groups/17506520-5a00-46ad-a9e2-15d389782411]."\n}' [ 876.357191] env[69232]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 17506520-5a00-46ad-a9e2-15d389782411 failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/17506520-5a00-46ad-a9e2-15d389782411 [ 876.357326] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 876.394052] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.394288] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.394288] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.394522] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.395554] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.395818] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.395971] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.396095] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.396208] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.396307] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.396515] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.396619] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.396667] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.396808] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.396882] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.396965] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 17506520-5a00-46ad-a9e2-15d389782411 is going to be created. [ 876.418354] env[69232]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/17506520-5a00-46ad-a9e2-15d389782411], does not exist path=[/infra/domains/default/groups/17506520-5a00-46ad-a9e2-15d389782411]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/17506520-5a00-46ad-a9e2-15d389782411 [ 876.418521] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-17506520-5a00-46ad-a9e2-15d389782411" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.419142] env[69232]: Traceback (most recent call last): [ 876.419203] env[69232]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 876.419203] env[69232]: return func(*args, **kwargs) [ 876.419203] env[69232]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 876.419203] env[69232]: res.raise_for_status() [ 876.419203] env[69232]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 876.419203] env[69232]: raise HTTPError(http_error_msg, response=self) [ 876.419203] env[69232]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/17506520-5a00-46ad-a9e2-15d389782411 [ 876.419203] env[69232]: During handling of the above exception, another exception occurred: [ 876.419203] env[69232]: Traceback (most recent call last): [ 876.419203] env[69232]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 876.419203] env[69232]: listener.cb(fileno) [ 876.419203] env[69232]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 876.419203] env[69232]: result = function(*args, **kwargs) [ 876.419203] env[69232]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 876.419203] env[69232]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 876.419203] env[69232]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 876.419203] env[69232]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 876.419203] env[69232]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 876.419203] env[69232]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 876.419203] env[69232]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 876.419203] env[69232]: res.raise_for_status() [ 876.419203] env[69232]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 876.419203] env[69232]: raise HTTPError(http_error_msg, response=self) [ 876.419203] env[69232]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/17506520-5a00-46ad-a9e2-15d389782411 [ 876.419928] env[69232]: Removing descriptor: 44 [ 877.011949] env[69232]: INFO networking_nsxv3.common.synchronization [req-064a6b5d-e3fb-4439-a14b-dba95ea62842 req-4ddf3f7d-a8c8-4525-b932-5327f67a24d8 tempest-DeleteServersTestJSON-830271628 tempest-DeleteServersTestJSON-830271628-project-member] Enqueued Resource ID: 9f5186e6-2d35-4ccf-a8b4-749a0a872128 with Priority: HIGHEST for action security_group_members [ 877.011949] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f5186e6-2d35-4ccf-a8b4-749a0a872128 with Priority: HIGHEST for action security_group_members [ 877.011949] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f5186e6-2d35-4ccf-a8b4-749a0a872128 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.011949] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.011949] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.011949] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.011949] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.011949] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.011949] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.011949] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.011949] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.011949] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9f5186e6-2d35-4ccf-a8b4-749a0a872128',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.330239] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock network-279 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.330620] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "network-279" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.330687] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "network-279" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.330977] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "network-279" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.331298] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.331479] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.331602] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.331831] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.332057] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.332202] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 877.332319] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] NeedRegenerationException {{(pid=69232) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 877.332431] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] no value, waiting for create lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 877.332540] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] value creation lock acquired {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 877.332666] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 877.333150] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Calling creation function for not-yet-present value {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 877.333150] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 877.357536] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 877.357824] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=69232) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 877.358359] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Released creation lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 877.358690] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "network-279" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.359297] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock port-528b82fb-f59b-4768-8118-e6e1a19d5b89 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.360216] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "port-528b82fb-f59b-4768-8118-e6e1a19d5b89" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.360216] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "port-528b82fb-f59b-4768-8118-e6e1a19d5b89" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.360216] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "port-528b82fb-f59b-4768-8118-e6e1a19d5b89" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.360364] env[69232]: DEBUG networking_nsxv3.api.rpc [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('528b82fb-f59b-4768-8118-e6e1a19d5b89',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.515953] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.516307] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.516478] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.516838] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.516980] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.517299] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.517449] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.517539] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.517840] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.517904] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.517942] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9f5186e6-2d35-4ccf-a8b4-749a0a872128 is going to be deleted. [ 877.552916] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.553063] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.553063] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.553277] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.553390] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.553503] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.573267] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e7bf0fa-24cf-40f7-ac38-1adabda5207c in Status: SUCCESS [ 877.573532] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e7bf0fa-24cf-40f7-ac38-1adabda5207c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.573759] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e7bf0fa-24cf-40f7-ac38-1adabda5207c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.573945] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e7bf0fa-24cf-40f7-ac38-1adabda5207c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.574138] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.574306] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.574364] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.574491] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.574571] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.574657] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e7bf0fa-24cf-40f7-ac38-1adabda5207c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.574748] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6e7bf0fa-24cf-40f7-ac38-1adabda5207c',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.839168] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a7a78fa-fad0-458c-afc2-e1d98c9176ab in Status: SUCCESS [ 877.839536] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.839768] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.840050] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.840286] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.840486] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.840594] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.840843] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.840977] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.841143] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.841347] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.841446] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.841524] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.841682] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.841831] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.841931] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.842016] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.842175] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.842254] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.842353] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.842450] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0a7a78fa-fad0-458c-afc2-e1d98c9176ab',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.843382] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.843566] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.843729] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.843847] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.843931] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.844614] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.844614] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.844614] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0a7a78fa-fad0-458c-afc2-e1d98c9176ab',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.863091] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.863405] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.863466] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.863749] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.863922] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.864097] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Segment Port 528b82fb-f59b-4768-8118-e6e1a19d5b89 not found, creating... [ 877.864410] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.864579] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.864703] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.864947] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.865128] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.865440] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.865616] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.865742] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.866372] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.866372] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.866372] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Resource: SegmentPort with ID: 528b82fb-f59b-4768-8118-e6e1a19d5b89 is going to be created. [ 877.890511] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.890753] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.890892] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.891351] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.891697] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.892037] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "port-528b82fb-f59b-4768-8118-e6e1a19d5b89" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.077622] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e7bf0fa-24cf-40f7-ac38-1adabda5207c taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.077761] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e7bf0fa-24cf-40f7-ac38-1adabda5207c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.077833] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e7bf0fa-24cf-40f7-ac38-1adabda5207c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.078066] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e7bf0fa-24cf-40f7-ac38-1adabda5207c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.078236] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.078349] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.078406] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.078563] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.078643] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.078726] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e7bf0fa-24cf-40f7-ac38-1adabda5207c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.078868] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e7bf0fa-24cf-40f7-ac38-1adabda5207c taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.079218] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e7bf0fa-24cf-40f7-ac38-1adabda5207c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.079218] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e7bf0fa-24cf-40f7-ac38-1adabda5207c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.079218] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e7bf0fa-24cf-40f7-ac38-1adabda5207c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.079391] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.079533] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.079627] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.080008] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.080300] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.080300] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e7bf0fa-24cf-40f7-ac38-1adabda5207c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.080586] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6e7bf0fa-24cf-40f7-ac38-1adabda5207c',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.346697] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0a7a78fa-fad0-458c-afc2-e1d98c9176ab: rpc.has_security_group_logging(os_id): False [ 878.348457] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0a7a78fa-fad0-458c-afc2-e1d98c9176ab',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.367565] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.367769] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.367769] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.367976] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.393023] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.393023] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.393023] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.393023] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.393274] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.393351] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.393590] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.393733] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.394409] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.394409] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.394409] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.394639] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.394639] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.394796] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.394994] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.398924] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.398924] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0a7a78fa-fad0-458c-afc2-e1d98c9176ab is going to be updated. [ 878.460463] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.460875] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.460875] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.460987] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.461155] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.478754] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0a7a78fa-fad0-458c-afc2-e1d98c9176ab in Status: IN_PROGRESS for 2s [ 878.583025] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6e7bf0fa-24cf-40f7-ac38-1adabda5207c: rpc.has_security_group_logging(os_id): False [ 878.612341] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.612499] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.612571] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.612795] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.612885] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.613095] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.613527] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.613527] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.613527] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.613527] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.613686] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.613745] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.613807] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.613946] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.614036] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.614220] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.614312] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.614376] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.614514] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.614588] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.614671] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6e7bf0fa-24cf-40f7-ac38-1adabda5207c is going to be created. [ 878.643024] env[69232]: INFO networking_nsxv3.common.synchronization [req-064a6b5d-e3fb-4439-a14b-dba95ea62842 req-5c0827ed-8fa3-4cf5-9e8a-7ab9bed5e35a service nova] Enqueued Resource ID: 9f5186e6-2d35-4ccf-a8b4-749a0a872128 with Priority: HIGHEST for action security_group_rules [ 878.643024] env[69232]: INFO networking_nsxv3.common.synchronization [req-064a6b5d-e3fb-4439-a14b-dba95ea62842 req-5c0827ed-8fa3-4cf5-9e8a-7ab9bed5e35a service nova] Enqueued Resource ID: 9f5186e6-2d35-4ccf-a8b4-749a0a872128 with Priority: HIGHEST for action security_group_members [ 878.643024] env[69232]: INFO networking_nsxv3.common.synchronization [req-064a6b5d-e3fb-4439-a14b-dba95ea62842 req-5c0827ed-8fa3-4cf5-9e8a-7ab9bed5e35a service nova] Enqueued Resource ID: 528b82fb-f59b-4768-8118-e6e1a19d5b89 with Priority: HIGHEST for action port [ 878.643024] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f5186e6-2d35-4ccf-a8b4-749a0a872128 with Priority: HIGHEST for action security_group_rules [ 878.643024] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f5186e6-2d35-4ccf-a8b4-749a0a872128 with Priority: HIGHEST for action security_group_members [ 878.643024] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 528b82fb-f59b-4768-8118-e6e1a19d5b89 with Priority: HIGHEST for action port [ 878.643024] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9f5186e6-2d35-4ccf-a8b4-749a0a872128 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.643718] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.643876] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.644208] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.644403] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9f5186e6-2d35-4ccf-a8b4-749a0a872128',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.646666] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f5186e6-2d35-4ccf-a8b4-749a0a872128 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.647710] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.647710] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.647710] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.647710] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.647710] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.647710] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.647710] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.647710] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.650852] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9f5186e6-2d35-4ccf-a8b4-749a0a872128',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.652295] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-528b82fb-f59b-4768-8118-e6e1a19d5b89 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.652295] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-528b82fb-f59b-4768-8118-e6e1a19d5b89" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.652295] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-528b82fb-f59b-4768-8118-e6e1a19d5b89" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.652295] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-528b82fb-f59b-4768-8118-e6e1a19d5b89" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.652295] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('528b82fb-f59b-4768-8118-e6e1a19d5b89',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.696810] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.697189] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.697328] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.697803] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.698121] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.722651] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6e7bf0fa-24cf-40f7-ac38-1adabda5207c in Status: IN_PROGRESS for 2s [ 878.851200] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0a7a78fa-fad0-458c-afc2-e1d98c9176ab',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.153555] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f5186e6-2d35-4ccf-a8b4-749a0a872128 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.153688] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.153884] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9f5186e6-2d35-4ccf-a8b4-749a0a872128',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.154995] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 528b82fb-f59b-4768-8118-e6e1a19d5b89 with status ACTIVE [ 879.155287] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.155659] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.155659] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.155659] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.155876] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.155930] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.156027] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.156115] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.156382] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.156494] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.156722] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.156826] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.156927] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.157053] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.157127] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.157199] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 528b82fb-f59b-4768-8118-e6e1a19d5b89 is going to be updated. [ 879.181218] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.181426] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.181426] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.181661] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.181793] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.181965] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-528b82fb-f59b-4768-8118-e6e1a19d5b89" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.353903] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.355132] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.355132] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.356024] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.356024] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.356024] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a7a78fa-fad0-458c-afc2-e1d98c9176ab is going to be updated. [ 879.388779] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.389035] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.389156] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.389292] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.389439] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.403143] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a7a78fa-fad0-458c-afc2-e1d98c9176ab in Status: IN_PROGRESS for 2s [ 879.659506] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9f5186e6-2d35-4ccf-a8b4-749a0a872128',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.687593] env[69232]: INFO networking_nsxv3.common.synchronization [req-d1f02c41-c07c-4dd3-b340-acf742d5e3fc req-21beb51e-f1d2-4d8a-b755-3600d157e590 tempest-ServersV294TestFqdnHostnames-617930467 tempest-ServersV294TestFqdnHostnames-617930467-project-member] Enqueued Resource ID: 345ff80e-1d3c-4ccc-95f9-bc828bfd5095 with Priority: HIGHEST for action security_group_members [ 879.688271] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 345ff80e-1d3c-4ccc-95f9-bc828bfd5095 with Priority: HIGHEST for action security_group_members [ 879.688683] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-345ff80e-1d3c-4ccc-95f9-bc828bfd5095 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.688833] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-345ff80e-1d3c-4ccc-95f9-bc828bfd5095" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.688976] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-345ff80e-1d3c-4ccc-95f9-bc828bfd5095" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.689271] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-345ff80e-1d3c-4ccc-95f9-bc828bfd5095" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.689460] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.689585] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.689652] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.689880] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.689936] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.690088] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('345ff80e-1d3c-4ccc-95f9-bc828bfd5095',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.997498] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock network-276 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.997698] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "network-276" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.997905] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "network-276" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.998349] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "network-276" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.998705] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.998938] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.999201] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.999464] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.999618] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.999836] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 879.999954] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] NeedRegenerationException {{(pid=69232) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 880.000076] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] no value, waiting for create lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 880.000189] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] value creation lock acquired {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 880.000301] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 880.000406] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Calling creation function for not-yet-present value {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 880.000540] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 880.020578] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 880.020578] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69232) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 880.020578] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Released creation lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 880.020704] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "network-276" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.021098] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock port-21bcb62b-1aed-41b8-8eb2-23d72f77bec7 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.021615] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "port-21bcb62b-1aed-41b8-8eb2-23d72f77bec7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.021615] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "port-21bcb62b-1aed-41b8-8eb2-23d72f77bec7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.021839] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "port-21bcb62b-1aed-41b8-8eb2-23d72f77bec7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.022101] env[69232]: DEBUG networking_nsxv3.api.rpc [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('21bcb62b-1aed-41b8-8eb2-23d72f77bec7',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.164950] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.164950] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.164950] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.164950] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.164950] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.164950] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9f5186e6-2d35-4ccf-a8b4-749a0a872128 is going to be created. [ 880.192584] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.192584] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.192584] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.192584] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.192584] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.195355] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.195658] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.195818] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.196144] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.196450] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.196768] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.196993] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.197168] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.197633] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.197814] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.197996] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 345ff80e-1d3c-4ccc-95f9-bc828bfd5095 already deleted. [ 880.198243] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-345ff80e-1d3c-4ccc-95f9-bc828bfd5095" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.203544] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f5186e6-2d35-4ccf-a8b4-749a0a872128 in Status: UNINITIALIZED for 2s [ 880.499814] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0a7a78fa-fad0-458c-afc2-e1d98c9176ab in Status: SUCCESS [ 880.500185] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.500580] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.500580] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.500748] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0a7a78fa-fad0-458c-afc2-e1d98c9176ab',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.525333] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.525333] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.525333] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.525651] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.525681] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.525866] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Segment Port 21bcb62b-1aed-41b8-8eb2-23d72f77bec7 not found, creating... [ 880.526166] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.526346] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.526473] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.526704] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.526872] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.527254] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.527442] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.527566] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.527791] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.527949] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.528105] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Resource: SegmentPort with ID: 21bcb62b-1aed-41b8-8eb2-23d72f77bec7 is going to be created. [ 880.559219] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.559219] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.559405] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.560026] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.560026] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.560237] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "port-21bcb62b-1aed-41b8-8eb2-23d72f77bec7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.745462] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6e7bf0fa-24cf-40f7-ac38-1adabda5207c in Status: SUCCESS [ 880.745813] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6e7bf0fa-24cf-40f7-ac38-1adabda5207c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.003534] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.003534] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.326286] env[69232]: INFO networking_nsxv3.common.synchronization [req-d1f02c41-c07c-4dd3-b340-acf742d5e3fc req-b5a178fd-7abf-4beb-8756-9e28e0069fa4 service nova] Enqueued Resource ID: 345ff80e-1d3c-4ccc-95f9-bc828bfd5095 with Priority: HIGHEST for action security_group_rules [ 881.329150] env[69232]: INFO networking_nsxv3.common.synchronization [req-d1f02c41-c07c-4dd3-b340-acf742d5e3fc req-b5a178fd-7abf-4beb-8756-9e28e0069fa4 service nova] Enqueued Resource ID: 345ff80e-1d3c-4ccc-95f9-bc828bfd5095 with Priority: HIGHEST for action security_group_members [ 881.329150] env[69232]: INFO networking_nsxv3.common.synchronization [req-d1f02c41-c07c-4dd3-b340-acf742d5e3fc req-b5a178fd-7abf-4beb-8756-9e28e0069fa4 service nova] Enqueued Resource ID: 21bcb62b-1aed-41b8-8eb2-23d72f77bec7 with Priority: HIGHEST for action port [ 881.329150] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 345ff80e-1d3c-4ccc-95f9-bc828bfd5095 with Priority: HIGHEST for action security_group_rules [ 881.329150] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 345ff80e-1d3c-4ccc-95f9-bc828bfd5095 with Priority: HIGHEST for action security_group_members [ 881.329150] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21bcb62b-1aed-41b8-8eb2-23d72f77bec7 with Priority: HIGHEST for action port [ 881.329150] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-345ff80e-1d3c-4ccc-95f9-bc828bfd5095 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.329150] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-345ff80e-1d3c-4ccc-95f9-bc828bfd5095" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.329150] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-345ff80e-1d3c-4ccc-95f9-bc828bfd5095" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.329150] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-345ff80e-1d3c-4ccc-95f9-bc828bfd5095" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.329150] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('345ff80e-1d3c-4ccc-95f9-bc828bfd5095',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.329150] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-345ff80e-1d3c-4ccc-95f9-bc828bfd5095 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.329150] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-345ff80e-1d3c-4ccc-95f9-bc828bfd5095" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.329150] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-345ff80e-1d3c-4ccc-95f9-bc828bfd5095" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.329150] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-345ff80e-1d3c-4ccc-95f9-bc828bfd5095" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.330092] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.330092] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.330092] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.330092] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.330092] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.330092] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('345ff80e-1d3c-4ccc-95f9-bc828bfd5095',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.330644] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-21bcb62b-1aed-41b8-8eb2-23d72f77bec7 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.330644] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-21bcb62b-1aed-41b8-8eb2-23d72f77bec7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.330644] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-21bcb62b-1aed-41b8-8eb2-23d72f77bec7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.330787] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-21bcb62b-1aed-41b8-8eb2-23d72f77bec7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.330814] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('21bcb62b-1aed-41b8-8eb2-23d72f77bec7',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.414192] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a7a78fa-fad0-458c-afc2-e1d98c9176ab in Status: SUCCESS [ 881.414514] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.414725] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.414976] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.415352] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.415477] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.415538] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.415727] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.415808] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.415905] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.416011] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0a7a78fa-fad0-458c-afc2-e1d98c9176ab',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.832394] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('345ff80e-1d3c-4ccc-95f9-bc828bfd5095',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.833611] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-345ff80e-1d3c-4ccc-95f9-bc828bfd5095 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.833766] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-345ff80e-1d3c-4ccc-95f9-bc828bfd5095" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.833940] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 21bcb62b-1aed-41b8-8eb2-23d72f77bec7 with status ACTIVE [ 881.834114] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.834238] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.834307] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.834517] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.834614] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.834784] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.834878] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.834934] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.836307] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.836394] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.836614] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.836713] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.840170] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.840358] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.840465] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.840568] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 21bcb62b-1aed-41b8-8eb2-23d72f77bec7 is going to be updated. [ 881.866910] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.867068] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.867141] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.867347] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.867566] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.868372] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-21bcb62b-1aed-41b8-8eb2-23d72f77bec7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.919530] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.919691] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.919748] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.919971] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.920157] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.920254] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.920315] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.920465] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.920575] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.920671] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.920835] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.920935] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.921094] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.921271] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.921412] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.921505] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.921563] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.921699] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.921771] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.921850] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.921939] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0a7a78fa-fad0-458c-afc2-e1d98c9176ab',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.213972] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f5186e6-2d35-4ccf-a8b4-749a0a872128 in Status: SUCCESS [ 882.214231] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.214489] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.214894] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.214894] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.214894] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.215125] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.215125] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.215205] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.215282] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.215374] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9f5186e6-2d35-4ccf-a8b4-749a0a872128',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.342410] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('345ff80e-1d3c-4ccc-95f9-bc828bfd5095',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.426840] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0a7a78fa-fad0-458c-afc2-e1d98c9176ab: rpc.has_security_group_logging(os_id): False [ 882.447018] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.447018] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.447018] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.447018] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.447018] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.447018] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.447018] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.447018] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.447018] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.447018] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.447018] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.447018] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.447018] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.447018] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.447018] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.447511] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.447511] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.447511] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.447511] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.447795] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.448023] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0a7a78fa-fad0-458c-afc2-e1d98c9176ab is going to be updated. [ 882.516522] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.516522] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.516522] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.516522] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.516522] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.543131] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0a7a78fa-fad0-458c-afc2-e1d98c9176ab in Status: IN_PROGRESS for 2s [ 882.724868] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f5186e6-2d35-4ccf-a8b4-749a0a872128 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.725317] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.725317] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.725317] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.725642] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.725725] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.725793] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.725961] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.726055] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.726144] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.726294] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f5186e6-2d35-4ccf-a8b4-749a0a872128 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.726385] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.726468] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.726730] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.726876] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.726965] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.727035] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.727185] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.727261] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.727342] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.727435] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9f5186e6-2d35-4ccf-a8b4-749a0a872128',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.846720] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.847066] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.847066] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.847451] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.847451] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.847649] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 345ff80e-1d3c-4ccc-95f9-bc828bfd5095 is going to be created. [ 882.882445] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.882650] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.882699] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.882908] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.883092] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.893511] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 345ff80e-1d3c-4ccc-95f9-bc828bfd5095 in Status: UNINITIALIZED for 2s [ 883.231560] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9f5186e6-2d35-4ccf-a8b4-749a0a872128: rpc.has_security_group_logging(os_id): False [ 883.262353] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.262353] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.262353] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.262353] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.262353] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.262803] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.262803] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.262803] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.262975] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.262975] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.264035] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.264035] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.264035] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.264035] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.264035] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.264035] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.264035] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.264035] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.264376] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.264376] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.264376] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9f5186e6-2d35-4ccf-a8b4-749a0a872128 is going to be created. [ 883.364214] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.364534] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.364534] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.364788] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.365027] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.398051] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9f5186e6-2d35-4ccf-a8b4-749a0a872128 in Status: IN_PROGRESS for 2s [ 884.565383] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0a7a78fa-fad0-458c-afc2-e1d98c9176ab in Status: SUCCESS [ 884.565651] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.781453] env[69232]: INFO networking_nsxv3.common.synchronization [req-f789ddc7-bf31-47a3-8886-0882b519fce9 req-dd14b20d-acb4-484c-814a-4c44dc2f2e50 tempest-ServersWithSpecificFlavorTestJSON-338716906 tempest-ServersWithSpecificFlavorTestJSON-338716906-project-member] Enqueued Resource ID: 06438b8f-6cee-4263-9d4c-43067bbe0a4c with Priority: HIGHEST for action security_group_members [ 884.783799] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06438b8f-6cee-4263-9d4c-43067bbe0a4c with Priority: HIGHEST for action security_group_members [ 884.784173] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-06438b8f-6cee-4263-9d4c-43067bbe0a4c taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.784301] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06438b8f-6cee-4263-9d4c-43067bbe0a4c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.784371] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06438b8f-6cee-4263-9d4c-43067bbe0a4c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.784571] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06438b8f-6cee-4263-9d4c-43067bbe0a4c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.784799] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.784866] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.784900] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.785417] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.785417] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.785417] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06438b8f-6cee-4263-9d4c-43067bbe0a4c',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.907802] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 345ff80e-1d3c-4ccc-95f9-bc828bfd5095 in Status: SUCCESS [ 884.907802] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-345ff80e-1d3c-4ccc-95f9-bc828bfd5095" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.907802] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-345ff80e-1d3c-4ccc-95f9-bc828bfd5095" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.907802] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-345ff80e-1d3c-4ccc-95f9-bc828bfd5095" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.907802] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.907802] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.907802] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.907802] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.907802] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.907802] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-345ff80e-1d3c-4ccc-95f9-bc828bfd5095" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.907802] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('345ff80e-1d3c-4ccc-95f9-bc828bfd5095',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.196988] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock network-295 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.197257] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "network-295" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.197393] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "network-295" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.199495] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "network-295" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.199495] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.199495] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.199495] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.199495] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.199495] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.199495] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 885.199495] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] NeedRegenerationException {{(pid=69232) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 885.199495] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] no value, waiting for create lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 885.199495] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] value creation lock acquired {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 885.199495] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 885.199495] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Calling creation function for not-yet-present value {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 885.200131] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 885.221646] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 885.221944] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69232) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 885.222226] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Released creation lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 885.222558] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "network-295" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.223104] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock port-1e9d4953-afd7-4fa1-aa7e-909295d79b36 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.223460] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "port-1e9d4953-afd7-4fa1-aa7e-909295d79b36" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.223962] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "port-1e9d4953-afd7-4fa1-aa7e-909295d79b36" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.224235] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "port-1e9d4953-afd7-4fa1-aa7e-909295d79b36" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.224497] env[69232]: DEBUG networking_nsxv3.api.rpc [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1e9d4953-afd7-4fa1-aa7e-909295d79b36',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.289520] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.289520] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.289520] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.289520] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.315928] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.316515] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.316515] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.316691] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.316915] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.317020] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.317172] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06438b8f-6cee-4263-9d4c-43067bbe0a4c is going to be updated. [ 885.381758] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.382022] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.382160] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.382483] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.382661] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.396394] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06438b8f-6cee-4263-9d4c-43067bbe0a4c in Status: IN_PROGRESS for 2s [ 885.410706] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('345ff80e-1d3c-4ccc-95f9-bc828bfd5095',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.416179] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9f5186e6-2d35-4ccf-a8b4-749a0a872128 in Status: SUCCESS [ 885.416423] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.728919] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.728919] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.728919] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.729291] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.729844] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.729844] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Segment Port 1e9d4953-afd7-4fa1-aa7e-909295d79b36 not found, creating... [ 885.729957] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.730126] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.730256] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.731038] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.731038] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.731038] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.731309] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.731309] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.731491] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.731667] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.731886] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Resource: SegmentPort with ID: 1e9d4953-afd7-4fa1-aa7e-909295d79b36 is going to be created. [ 885.757347] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.757595] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.757801] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.758014] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.758261] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.758513] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "port-1e9d4953-afd7-4fa1-aa7e-909295d79b36" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.913513] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 345ff80e-1d3c-4ccc-95f9-bc828bfd5095: rpc.has_security_group_logging(os_id): False [ 885.934631] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.934869] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.934918] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.935154] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.935252] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.935534] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.935640] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.935704] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.935869] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.935949] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.936058] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 345ff80e-1d3c-4ccc-95f9-bc828bfd5095 is going to be created. [ 886.009201] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.009201] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.009201] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.009505] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.009505] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.024430] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 345ff80e-1d3c-4ccc-95f9-bc828bfd5095 in Status: IN_PROGRESS for 2s [ 886.548367] env[69232]: INFO networking_nsxv3.common.synchronization [req-f789ddc7-bf31-47a3-8886-0882b519fce9 req-1e7ca1a2-3e8f-4269-8334-960cbf27503a service nova] Enqueued Resource ID: 06438b8f-6cee-4263-9d4c-43067bbe0a4c with Priority: HIGHEST for action security_group_rules [ 886.548554] env[69232]: INFO networking_nsxv3.common.synchronization [req-f789ddc7-bf31-47a3-8886-0882b519fce9 req-1e7ca1a2-3e8f-4269-8334-960cbf27503a service nova] Enqueued Resource ID: 06438b8f-6cee-4263-9d4c-43067bbe0a4c with Priority: HIGHEST for action security_group_members [ 886.548707] env[69232]: INFO networking_nsxv3.common.synchronization [req-f789ddc7-bf31-47a3-8886-0882b519fce9 req-1e7ca1a2-3e8f-4269-8334-960cbf27503a service nova] Enqueued Resource ID: 1e9d4953-afd7-4fa1-aa7e-909295d79b36 with Priority: HIGHEST for action port [ 886.548946] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06438b8f-6cee-4263-9d4c-43067bbe0a4c with Priority: HIGHEST for action security_group_rules [ 886.549136] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06438b8f-6cee-4263-9d4c-43067bbe0a4c with Priority: HIGHEST for action security_group_members [ 886.550040] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e9d4953-afd7-4fa1-aa7e-909295d79b36 with Priority: HIGHEST for action port [ 886.550354] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-06438b8f-6cee-4263-9d4c-43067bbe0a4c taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.551608] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-06438b8f-6cee-4263-9d4c-43067bbe0a4c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.551608] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-06438b8f-6cee-4263-9d4c-43067bbe0a4c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.551608] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-06438b8f-6cee-4263-9d4c-43067bbe0a4c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.551608] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('06438b8f-6cee-4263-9d4c-43067bbe0a4c',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.551841] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-06438b8f-6cee-4263-9d4c-43067bbe0a4c taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.551890] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06438b8f-6cee-4263-9d4c-43067bbe0a4c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.552130] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-1e9d4953-afd7-4fa1-aa7e-909295d79b36 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.552227] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1e9d4953-afd7-4fa1-aa7e-909295d79b36" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.552296] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1e9d4953-afd7-4fa1-aa7e-909295d79b36" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.552518] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1e9d4953-afd7-4fa1-aa7e-909295d79b36" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.552597] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1e9d4953-afd7-4fa1-aa7e-909295d79b36',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.054540] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-06438b8f-6cee-4263-9d4c-43067bbe0a4c taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.058145] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06438b8f-6cee-4263-9d4c-43067bbe0a4c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.058145] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1e9d4953-afd7-4fa1-aa7e-909295d79b36 with status ACTIVE [ 887.058145] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.058145] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.058145] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.058145] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.058145] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.058145] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.058145] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.058145] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.058145] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.058145] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.058145] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.058145] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.058145] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.058145] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.058145] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.058653] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1e9d4953-afd7-4fa1-aa7e-909295d79b36 is going to be updated. [ 887.082596] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.082596] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.082596] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.082596] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.082596] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.082596] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1e9d4953-afd7-4fa1-aa7e-909295d79b36" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.408469] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06438b8f-6cee-4263-9d4c-43067bbe0a4c in Status: SUCCESS [ 887.408832] env[69232]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06438b8f-6cee-4263-9d4c-43067bbe0a4c deletion is rescheduled due to dependency. [ 887.408962] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06438b8f-6cee-4263-9d4c-43067bbe0a4c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.409254] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06438b8f-6cee-4263-9d4c-43067bbe0a4c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.409552] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06438b8f-6cee-4263-9d4c-43067bbe0a4c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.409790] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.409881] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.409916] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.410204] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.410275] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.410304] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06438b8f-6cee-4263-9d4c-43067bbe0a4c',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.913128] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('06438b8f-6cee-4263-9d4c-43067bbe0a4c',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.065785] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 345ff80e-1d3c-4ccc-95f9-bc828bfd5095 in Status: SUCCESS [ 888.066192] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-345ff80e-1d3c-4ccc-95f9-bc828bfd5095" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.416864] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('06438b8f-6cee-4263-9d4c-43067bbe0a4c',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.923600] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.923810] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.923878] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.924167] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.924209] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.924315] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06438b8f-6cee-4263-9d4c-43067bbe0a4c is going to be updated. [ 888.960492] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.960697] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.960888] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.961196] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.961377] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.974222] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06438b8f-6cee-4263-9d4c-43067bbe0a4c in Status: IN_PROGRESS for 2s [ 890.185022] env[69232]: INFO networking_nsxv3.common.synchronization [req-3e68f60f-78e3-4f33-bd77-50760d5332ef req-f3753feb-513d-463b-b621-881f91ca5088 tempest-ImagesTestJSON-1245210724 tempest-ImagesTestJSON-1245210724-project-member] Enqueued Resource ID: fb3494b9-4ce5-4744-a378-ecbcd5c2bec9 with Priority: HIGHEST for action security_group_members [ 890.185022] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb3494b9-4ce5-4744-a378-ecbcd5c2bec9 with Priority: HIGHEST for action security_group_members [ 890.185022] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.185022] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.185022] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.185022] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.185022] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.185022] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.185022] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.185022] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.185022] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.185022] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fb3494b9-4ce5-4744-a378-ecbcd5c2bec9',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.580307] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock network-674 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.580307] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "network-674" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.580490] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "network-674" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.580673] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "network-674" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.580961] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.581162] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.581292] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.581499] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.581731] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.581876] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 890.582019] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] NeedRegenerationException {{(pid=69232) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 890.582147] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] no value, waiting for create lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 890.582261] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] value creation lock acquired {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 890.582479] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 890.582588] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Calling creation function for not-yet-present value {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 890.582692] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 890.604985] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 890.605290] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69232) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 890.605673] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Released creation lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 890.605865] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "network-674" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.606301] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock port-60bef371-c928-44c1-9d4e-48e59cae4401 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.606428] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "port-60bef371-c928-44c1-9d4e-48e59cae4401" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.606508] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "port-60bef371-c928-44c1-9d4e-48e59cae4401" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.606838] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "port-60bef371-c928-44c1-9d4e-48e59cae4401" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.606987] env[69232]: DEBUG networking_nsxv3.api.rpc [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('60bef371-c928-44c1-9d4e-48e59cae4401',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.687775] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.687985] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.688068] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.688247] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.713307] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.713727] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.713911] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.714075] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.714441] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.714595] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.714756] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb3494b9-4ce5-4744-a378-ecbcd5c2bec9 is going to be updated. [ 890.752480] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.752705] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.752705] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.752886] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.753058] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.767555] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb3494b9-4ce5-4744-a378-ecbcd5c2bec9 in Status: IN_PROGRESS for 2s [ 890.988646] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06438b8f-6cee-4263-9d4c-43067bbe0a4c in Status: SUCCESS [ 890.988929] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06438b8f-6cee-4263-9d4c-43067bbe0a4c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.989177] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06438b8f-6cee-4263-9d4c-43067bbe0a4c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.989346] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06438b8f-6cee-4263-9d4c-43067bbe0a4c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.989535] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.989685] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.989731] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.989880] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.989956] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.990102] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06438b8f-6cee-4263-9d4c-43067bbe0a4c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.990102] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('06438b8f-6cee-4263-9d4c-43067bbe0a4c',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.109852] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.110114] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.110252] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.110554] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.110713] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.110878] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Segment Port 60bef371-c928-44c1-9d4e-48e59cae4401 not found, creating... [ 891.111219] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.111529] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.111529] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.111746] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.111883] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.112221] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.112389] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.112511] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.112734] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.112875] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.113040] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Resource: SegmentPort with ID: 60bef371-c928-44c1-9d4e-48e59cae4401 is going to be created. [ 891.268084] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.268494] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.268621] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.268912] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.269175] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.269421] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "port-60bef371-c928-44c1-9d4e-48e59cae4401" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.492804] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('06438b8f-6cee-4263-9d4c-43067bbe0a4c',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.995464] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 06438b8f-6cee-4263-9d4c-43067bbe0a4c: rpc.has_security_group_logging(os_id): False [ 892.026246] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.026246] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.026246] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.026246] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.026246] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.026246] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.026246] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.026246] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.026246] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.026246] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.026246] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 06438b8f-6cee-4263-9d4c-43067bbe0a4c is going to be updated. [ 892.093816] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.093977] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.094056] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.094264] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.094406] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.109425] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 06438b8f-6cee-4263-9d4c-43067bbe0a4c in Status: IN_PROGRESS for 2s [ 892.118963] env[69232]: INFO networking_nsxv3.common.synchronization [req-3e68f60f-78e3-4f33-bd77-50760d5332ef req-78e6ce6f-ef13-447e-8111-13c48e9846cb service nova] Enqueued Resource ID: fb3494b9-4ce5-4744-a378-ecbcd5c2bec9 with Priority: HIGHEST for action security_group_rules [ 892.119153] env[69232]: INFO networking_nsxv3.common.synchronization [req-3e68f60f-78e3-4f33-bd77-50760d5332ef req-78e6ce6f-ef13-447e-8111-13c48e9846cb service nova] Enqueued Resource ID: fb3494b9-4ce5-4744-a378-ecbcd5c2bec9 with Priority: HIGHEST for action security_group_members [ 892.119309] env[69232]: INFO networking_nsxv3.common.synchronization [req-3e68f60f-78e3-4f33-bd77-50760d5332ef req-78e6ce6f-ef13-447e-8111-13c48e9846cb service nova] Enqueued Resource ID: 60bef371-c928-44c1-9d4e-48e59cae4401 with Priority: HIGHEST for action port [ 892.119520] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb3494b9-4ce5-4744-a378-ecbcd5c2bec9 with Priority: HIGHEST for action security_group_rules [ 892.120022] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb3494b9-4ce5-4744-a378-ecbcd5c2bec9 with Priority: HIGHEST for action security_group_members [ 892.120184] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60bef371-c928-44c1-9d4e-48e59cae4401 with Priority: HIGHEST for action port [ 892.120771] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.121426] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.121426] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.121426] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.122576] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fb3494b9-4ce5-4744-a378-ecbcd5c2bec9',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.125077] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.125262] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.125543] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-60bef371-c928-44c1-9d4e-48e59cae4401 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.125649] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-60bef371-c928-44c1-9d4e-48e59cae4401" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.125726] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-60bef371-c928-44c1-9d4e-48e59cae4401" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.125980] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-60bef371-c928-44c1-9d4e-48e59cae4401" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.126163] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('60bef371-c928-44c1-9d4e-48e59cae4401',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.629535] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.629816] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.629892] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 60bef371-c928-44c1-9d4e-48e59cae4401 with status ACTIVE [ 892.630098] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.630233] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.630317] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.630540] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.630642] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.630829] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.630925] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.631011] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.631252] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.631341] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.631543] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.631640] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.631710] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.631882] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.631961] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.632063] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 60bef371-c928-44c1-9d4e-48e59cae4401 is going to be updated. [ 892.663904] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.664194] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.664303] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.664615] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.664780] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.665025] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-60bef371-c928-44c1-9d4e-48e59cae4401" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.777946] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb3494b9-4ce5-4744-a378-ecbcd5c2bec9 in Status: SUCCESS [ 892.778211] env[69232]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb3494b9-4ce5-4744-a378-ecbcd5c2bec9 deletion is rescheduled due to dependency. [ 892.778361] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.778572] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.778813] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.779015] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.779217] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.779289] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.779460] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.779558] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.779654] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fb3494b9-4ce5-4744-a378-ecbcd5c2bec9',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.283378] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fb3494b9-4ce5-4744-a378-ecbcd5c2bec9',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.786185] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fb3494b9-4ce5-4744-a378-ecbcd5c2bec9',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.124765] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 06438b8f-6cee-4263-9d4c-43067bbe0a4c in Status: SUCCESS [ 894.124955] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-06438b8f-6cee-4263-9d4c-43067bbe0a4c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.289986] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.290183] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.290251] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.290477] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.290566] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.290671] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb3494b9-4ce5-4744-a378-ecbcd5c2bec9 is going to be updated. [ 894.324394] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.324657] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.324739] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.324984] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.325158] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.336950] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb3494b9-4ce5-4744-a378-ecbcd5c2bec9 in Status: IN_PROGRESS for 2s [ 895.211127] env[69232]: INFO networking_nsxv3.common.synchronization [req-50818639-1268-4c79-be4b-0ca43f405735 req-77673f9b-5655-4c95-963e-6d1c32c48bdb tempest-ImagesOneServerNegativeTestJSON-501782696 tempest-ImagesOneServerNegativeTestJSON-501782696-project-member] Enqueued Resource ID: 6e7bf0fa-24cf-40f7-ac38-1adabda5207c with Priority: HIGHEST for action security_group_members [ 895.211127] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e7bf0fa-24cf-40f7-ac38-1adabda5207c with Priority: HIGHEST for action security_group_members [ 895.211127] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e7bf0fa-24cf-40f7-ac38-1adabda5207c taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.211127] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e7bf0fa-24cf-40f7-ac38-1adabda5207c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.211127] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e7bf0fa-24cf-40f7-ac38-1adabda5207c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.211127] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e7bf0fa-24cf-40f7-ac38-1adabda5207c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.211127] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.211127] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.211127] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.211127] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.215339] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.215609] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6e7bf0fa-24cf-40f7-ac38-1adabda5207c',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.720251] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.720422] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.720610] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.720708] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.720796] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.721077] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.721134] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.721175] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.721370] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.721432] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.721528] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e7bf0fa-24cf-40f7-ac38-1adabda5207c is going to be updated. [ 895.744155] env[69232]: INFO networking_nsxv3.common.synchronization [req-81aadb92-bf8f-44cf-a792-033c915db03f req-376bb361-4924-4af7-aeef-04673b687913 tempest-ServersTestJSON-524901877 tempest-ServersTestJSON-524901877-project-member] Enqueued Resource ID: bdcc7a21-dd0d-4296-ac34-a880ea6123e7 with Priority: HIGHEST for action security_group_members [ 895.744155] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdcc7a21-dd0d-4296-ac34-a880ea6123e7 with Priority: HIGHEST for action security_group_members [ 895.744406] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.744483] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.744483] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.744697] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.744849] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.744947] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.745021] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.745170] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.745256] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.745718] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bdcc7a21-dd0d-4296-ac34-a880ea6123e7',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.753296] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.753712] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.753924] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.756541] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.756541] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.766280] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e7bf0fa-24cf-40f7-ac38-1adabda5207c in Status: IN_PROGRESS for 2s [ 896.253046] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bdcc7a21-dd0d-4296-ac34-a880ea6123e7',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.347995] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb3494b9-4ce5-4744-a378-ecbcd5c2bec9 in Status: SUCCESS [ 896.348251] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.348413] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.348619] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.348803] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.348914] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.349023] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.349256] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.349370] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.349492] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.349628] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fb3494b9-4ce5-4744-a378-ecbcd5c2bec9',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.640750] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock network-738 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.640994] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "network-738" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.641207] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "network-738" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.641534] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "network-738" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.641740] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.641902] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.642310] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.642577] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.642737] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.642955] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 896.643088] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] NeedRegenerationException {{(pid=69232) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 896.643206] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] no value, waiting for create lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 896.643317] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] value creation lock acquired {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 896.643430] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 896.643542] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Calling creation function for not-yet-present value {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 896.643704] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 896.665591] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 896.665773] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69232) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 896.665914] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Released creation lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 896.666116] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "network-738" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.666436] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock port-d60b56f4-df73-4910-912b-377e88ab244c taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.666615] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "port-d60b56f4-df73-4910-912b-377e88ab244c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.666761] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "port-d60b56f4-df73-4910-912b-377e88ab244c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.667128] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "port-d60b56f4-df73-4910-912b-377e88ab244c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.667248] env[69232]: DEBUG networking_nsxv3.api.rpc [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d60b56f4-df73-4910-912b-377e88ab244c',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.756702] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bdcc7a21-dd0d-4296-ac34-a880ea6123e7',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.853028] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.853385] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.853385] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.853648] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.853865] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.854050] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.854050] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.854292] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.854415] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.854532] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.854674] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.854908] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.854908] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.854995] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.855135] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.855930] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.856486] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.856486] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.856486] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.856636] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.856636] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fb3494b9-4ce5-4744-a378-ecbcd5c2bec9',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.173079] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.173079] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.173079] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.173079] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.173079] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.173079] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Segment Port d60b56f4-df73-4910-912b-377e88ab244c not found, creating... [ 897.173079] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.173079] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.173079] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.173079] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.173079] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.173598] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.173598] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.173598] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.173598] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.174288] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.174650] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Resource: SegmentPort with ID: d60b56f4-df73-4910-912b-377e88ab244c is going to be created. [ 897.200026] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.200026] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.200026] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.200026] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.200026] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.200026] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "port-d60b56f4-df73-4910-912b-377e88ab244c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.268043] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.268043] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.268043] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.268043] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.268043] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.268043] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bdcc7a21-dd0d-4296-ac34-a880ea6123e7 is going to be updated. [ 897.318024] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.318024] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.318024] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.318024] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.318024] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.336530] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bdcc7a21-dd0d-4296-ac34-a880ea6123e7 in Status: IN_PROGRESS for 2s [ 897.360680] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fb3494b9-4ce5-4744-a378-ecbcd5c2bec9: rpc.has_security_group_logging(os_id): False [ 897.409857] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.410121] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.410200] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.410483] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.410641] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.410952] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.411124] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.411271] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.411532] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.411622] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.412453] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.412640] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.412712] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.412988] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.413903] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.413903] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.413903] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.413903] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.414126] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.414202] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.414305] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fb3494b9-4ce5-4744-a378-ecbcd5c2bec9 is going to be updated. [ 897.512296] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.512479] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.512573] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.512790] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.512938] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.533268] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fb3494b9-4ce5-4744-a378-ecbcd5c2bec9 in Status: IN_PROGRESS for 2s [ 897.777940] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e7bf0fa-24cf-40f7-ac38-1adabda5207c in Status: SUCCESS [ 897.778188] env[69232]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e7bf0fa-24cf-40f7-ac38-1adabda5207c deletion is rescheduled due to dependency. [ 897.778308] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e7bf0fa-24cf-40f7-ac38-1adabda5207c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.429562] env[69232]: INFO networking_nsxv3.common.synchronization [req-81aadb92-bf8f-44cf-a792-033c915db03f req-206684f5-4cb8-44ce-860d-9583b797c0ac service nova] Enqueued Resource ID: bdcc7a21-dd0d-4296-ac34-a880ea6123e7 with Priority: HIGHEST for action security_group_rules [ 898.429905] env[69232]: INFO networking_nsxv3.common.synchronization [req-81aadb92-bf8f-44cf-a792-033c915db03f req-206684f5-4cb8-44ce-860d-9583b797c0ac service nova] Enqueued Resource ID: bdcc7a21-dd0d-4296-ac34-a880ea6123e7 with Priority: HIGHEST for action security_group_members [ 898.429905] env[69232]: INFO networking_nsxv3.common.synchronization [req-81aadb92-bf8f-44cf-a792-033c915db03f req-206684f5-4cb8-44ce-860d-9583b797c0ac service nova] Enqueued Resource ID: d60b56f4-df73-4910-912b-377e88ab244c with Priority: HIGHEST for action port [ 898.430454] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdcc7a21-dd0d-4296-ac34-a880ea6123e7 with Priority: HIGHEST for action security_group_rules [ 898.430541] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdcc7a21-dd0d-4296-ac34-a880ea6123e7 with Priority: HIGHEST for action security_group_members [ 898.430639] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d60b56f4-df73-4910-912b-377e88ab244c with Priority: HIGHEST for action port [ 898.431036] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bdcc7a21-dd0d-4296-ac34-a880ea6123e7 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.431255] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.431355] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.431576] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.431661] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bdcc7a21-dd0d-4296-ac34-a880ea6123e7',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.433364] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.433561] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.433739] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-d60b56f4-df73-4910-912b-377e88ab244c taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.433843] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d60b56f4-df73-4910-912b-377e88ab244c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.433912] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d60b56f4-df73-4910-912b-377e88ab244c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.434125] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d60b56f4-df73-4910-912b-377e88ab244c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.434207] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d60b56f4-df73-4910-912b-377e88ab244c',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.936012] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.936193] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.936355] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d60b56f4-df73-4910-912b-377e88ab244c with status ACTIVE [ 898.936548] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.936693] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.936769] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.936983] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.937088] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.937262] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.937620] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.937900] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.938168] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.938342] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.938595] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.938697] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.938852] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.939250] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.939250] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.939376] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d60b56f4-df73-4910-912b-377e88ab244c is going to be updated. [ 898.964118] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.964297] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.964375] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.964580] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.964720] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.964883] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d60b56f4-df73-4910-912b-377e88ab244c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.347678] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bdcc7a21-dd0d-4296-ac34-a880ea6123e7 in Status: SUCCESS [ 899.347892] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.348083] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.348390] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.348634] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.348798] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.348884] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.349126] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.349217] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.349325] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bdcc7a21-dd0d-4296-ac34-a880ea6123e7',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.548075] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fb3494b9-4ce5-4744-a378-ecbcd5c2bec9 in Status: SUCCESS [ 899.548476] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.852098] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bdcc7a21-dd0d-4296-ac34-a880ea6123e7',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.146219] env[69232]: INFO networking_nsxv3.common.synchronization [None req-3d8260d3-a818-4aa4-a819-5134df00026c None None] Enqueued Resource ID: f811791f-ecba-4f1c-9f0a-b984b37b38d5 with Priority: HIGHEST for action port [ 900.149146] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f811791f-ecba-4f1c-9f0a-b984b37b38d5 with Priority: HIGHEST for action port [ 900.149563] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-f811791f-ecba-4f1c-9f0a-b984b37b38d5 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.149701] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f811791f-ecba-4f1c-9f0a-b984b37b38d5" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.149774] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f811791f-ecba-4f1c-9f0a-b984b37b38d5" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.150101] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f811791f-ecba-4f1c-9f0a-b984b37b38d5" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.150151] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f811791f-ecba-4f1c-9f0a-b984b37b38d5',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.355545] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bdcc7a21-dd0d-4296-ac34-a880ea6123e7',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.655051] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f811791f-ecba-4f1c-9f0a-b984b37b38d5 [ 900.655325] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.655432] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.655599] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.655892] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.656065] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.656209] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f811791f-ecba-4f1c-9f0a-b984b37b38d5 already deleted. [ 900.656375] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f811791f-ecba-4f1c-9f0a-b984b37b38d5" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.860645] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.863088] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.863352] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.863447] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.863558] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.863677] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bdcc7a21-dd0d-4296-ac34-a880ea6123e7 is going to be updated. [ 900.897105] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.897265] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.897352] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.897560] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.897789] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.910901] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bdcc7a21-dd0d-4296-ac34-a880ea6123e7 in Status: IN_PROGRESS for 2s [ 901.195211] env[69232]: INFO networking_nsxv3.common.synchronization [None req-0adf005f-fbc4-4b04-b1d3-f2d17306c801 tempest-AttachVolumeNegativeTest-731570695 tempest-AttachVolumeNegativeTest-731570695-project-member] Enqueued Resource ID: 9dfe0542-c4f4-46ef-bdfa-784cec941ec2 with Priority: HIGHEST for action security_group_rules [ 901.195735] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9dfe0542-c4f4-46ef-bdfa-784cec941ec2 with Priority: HIGHEST for action security_group_rules [ 901.196037] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9dfe0542-c4f4-46ef-bdfa-784cec941ec2 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.196157] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9dfe0542-c4f4-46ef-bdfa-784cec941ec2" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.196218] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9dfe0542-c4f4-46ef-bdfa-784cec941ec2" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.196485] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9dfe0542-c4f4-46ef-bdfa-784cec941ec2" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.196569] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9dfe0542-c4f4-46ef-bdfa-784cec941ec2',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.287790] env[69232]: INFO networking_nsxv3.common.synchronization [None req-6c4dc508-115f-409a-9ecc-017f68208e5a tempest-AttachVolumeNegativeTest-731570695 tempest-AttachVolumeNegativeTest-731570695-project-member] Enqueued Resource ID: 9dfe0542-c4f4-46ef-bdfa-784cec941ec2 with Priority: HIGHEST for action security_group_rules [ 901.288333] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9dfe0542-c4f4-46ef-bdfa-784cec941ec2 with Priority: HIGHEST for action security_group_rules [ 901.288674] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9dfe0542-c4f4-46ef-bdfa-784cec941ec2 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.288823] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9dfe0542-c4f4-46ef-bdfa-784cec941ec2" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.721779] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.721779] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.721779] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.721779] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.721779] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.721779] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9dfe0542-c4f4-46ef-bdfa-784cec941ec2 already deleted. [ 901.721779] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9dfe0542-c4f4-46ef-bdfa-784cec941ec2" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.721779] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9dfe0542-c4f4-46ef-bdfa-784cec941ec2" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.721779] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9dfe0542-c4f4-46ef-bdfa-784cec941ec2" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.721779] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9dfe0542-c4f4-46ef-bdfa-784cec941ec2',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.244489] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.244489] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.244489] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.244718] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.244970] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.244970] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9dfe0542-c4f4-46ef-bdfa-784cec941ec2 already deleted. [ 902.244970] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9dfe0542-c4f4-46ef-bdfa-784cec941ec2" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.843735] env[69232]: INFO networking_nsxv3.common.synchronization [None req-5a0ab576-c8f4-4890-b4c8-66db1c8cd7fb None None] Enqueued Resource ID: 6d917845-c506-4854-8648-252f00e4a7e9 with Priority: HIGHEST for action port [ 902.844017] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d917845-c506-4854-8648-252f00e4a7e9 with Priority: HIGHEST for action port [ 902.844607] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-6d917845-c506-4854-8648-252f00e4a7e9 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.844743] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6d917845-c506-4854-8648-252f00e4a7e9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.844813] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6d917845-c506-4854-8648-252f00e4a7e9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.848307] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6d917845-c506-4854-8648-252f00e4a7e9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.848866] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6d917845-c506-4854-8648-252f00e4a7e9',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.922172] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bdcc7a21-dd0d-4296-ac34-a880ea6123e7 in Status: SUCCESS [ 902.922253] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.922415] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.922646] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.922848] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.922972] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.923052] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.923219] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.923304] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.923668] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.923821] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bdcc7a21-dd0d-4296-ac34-a880ea6123e7',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.352116] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6d917845-c506-4854-8648-252f00e4a7e9 [ 903.352116] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.352116] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.352116] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.353349] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.353349] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.353455] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6d917845-c506-4854-8648-252f00e4a7e9 already deleted. [ 903.353549] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6d917845-c506-4854-8648-252f00e4a7e9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.428316] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.428457] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.428581] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.428895] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.429788] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.429788] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.429788] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.429788] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.429936] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.430072] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.430238] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.430395] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.430511] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.430739] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.431157] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.431343] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.431464] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.431696] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.431844] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.431991] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.432731] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bdcc7a21-dd0d-4296-ac34-a880ea6123e7',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.935591] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bdcc7a21-dd0d-4296-ac34-a880ea6123e7: rpc.has_security_group_logging(os_id): False [ 903.962060] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.962385] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.962727] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.968160] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.990693] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.991491] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.991774] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.991932] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.992265] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.992433] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.992801] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.993137] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.993267] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.993555] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.993718] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.993977] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.994165] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.994270] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.994546] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.994707] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.994883] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bdcc7a21-dd0d-4296-ac34-a880ea6123e7 is going to be updated. [ 904.059163] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.059412] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.059458] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.059663] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.059824] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.076757] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bdcc7a21-dd0d-4296-ac34-a880ea6123e7 in Status: IN_PROGRESS for 2s [ 905.092230] env[69232]: INFO networking_nsxv3.common.synchronization [req-f9bb1bcb-f377-4aea-b5a4-29bdf27c726f req-b5cfa420-0dbc-448c-b245-10775efb2ea2 tempest-DeleteServersTestJSON-830271628 tempest-DeleteServersTestJSON-830271628-project-member] Enqueued Resource ID: 9f5186e6-2d35-4ccf-a8b4-749a0a872128 with Priority: HIGHEST for action security_group_members [ 905.092711] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f5186e6-2d35-4ccf-a8b4-749a0a872128 with Priority: HIGHEST for action security_group_members [ 905.092934] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f5186e6-2d35-4ccf-a8b4-749a0a872128 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.093078] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.093148] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.093342] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.093499] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.093615] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.093731] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.093849] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.093935] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.094043] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9f5186e6-2d35-4ccf-a8b4-749a0a872128',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.595860] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.596043] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.596146] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.596324] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.596421] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.596618] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.596717] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.596767] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.596929] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.597009] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.597114] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9f5186e6-2d35-4ccf-a8b4-749a0a872128 is going to be updated. [ 905.629845] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.630364] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.630647] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.630957] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.631204] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.645582] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f5186e6-2d35-4ccf-a8b4-749a0a872128 in Status: IN_PROGRESS for 2s [ 905.824212] env[69232]: INFO networking_nsxv3.common.synchronization [req-1371a20c-1c20-4931-8a9c-990883d3036d req-20e536f5-4183-4489-8aa8-c5828a0a40db tempest-ServersAdminTestJSON-2143393640 tempest-ServersAdminTestJSON-2143393640-project-member] Enqueued Resource ID: d2391c01-2410-4874-a5a8-6da2d957e88c with Priority: HIGHEST for action security_group_members [ 905.825580] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2391c01-2410-4874-a5a8-6da2d957e88c with Priority: HIGHEST for action security_group_members [ 905.825580] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2391c01-2410-4874-a5a8-6da2d957e88c taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.825580] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2391c01-2410-4874-a5a8-6da2d957e88c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.825859] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2391c01-2410-4874-a5a8-6da2d957e88c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.826679] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2391c01-2410-4874-a5a8-6da2d957e88c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.826679] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.826679] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.826679] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.826679] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.826979] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.826979] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d2391c01-2410-4874-a5a8-6da2d957e88c',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.097439] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bdcc7a21-dd0d-4296-ac34-a880ea6123e7 in Status: SUCCESS [ 906.097809] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.219595] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock network-186 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.219892] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "network-186" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.220095] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "network-186" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.220448] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "network-186" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.220771] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.220963] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.221179] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.221450] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.221636] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.221867] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 906.221990] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] NeedRegenerationException {{(pid=69232) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 906.222174] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] no value, waiting for create lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 906.222310] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] value creation lock acquired {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 906.222467] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 906.222581] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Calling creation function for not-yet-present value {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 906.222722] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 906.243990] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 906.243990] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69232) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 906.243990] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Released creation lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 906.244202] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "network-186" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.244724] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock port-a2540417-6d9d-4985-882b-b4a9bb6b1ee9 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.244724] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "port-a2540417-6d9d-4985-882b-b4a9bb6b1ee9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.244936] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "port-a2540417-6d9d-4985-882b-b4a9bb6b1ee9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.245095] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "port-a2540417-6d9d-4985-882b-b4a9bb6b1ee9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.245238] env[69232]: DEBUG networking_nsxv3.api.rpc [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a2540417-6d9d-4985-882b-b4a9bb6b1ee9',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.329402] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d2391c01-2410-4874-a5a8-6da2d957e88c',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.748726] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.748964] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.749117] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.749444] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.749607] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.749770] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Segment Port a2540417-6d9d-4985-882b-b4a9bb6b1ee9 not found, creating... [ 906.750056] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.750232] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.750358] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.750586] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.750729] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.751018] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.751180] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.751356] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.751567] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.751706] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.751848] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Resource: SegmentPort with ID: a2540417-6d9d-4985-882b-b4a9bb6b1ee9 is going to be created. [ 906.774745] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.775010] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.775112] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.775382] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.775614] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.775846] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "port-a2540417-6d9d-4985-882b-b4a9bb6b1ee9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.831938] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d2391c01-2410-4874-a5a8-6da2d957e88c',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.336038] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.336038] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.336038] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.336038] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.336038] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.336038] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d2391c01-2410-4874-a5a8-6da2d957e88c is going to be updated. [ 907.363075] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.363294] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.363373] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.363706] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.363929] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.376563] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d2391c01-2410-4874-a5a8-6da2d957e88c in Status: IN_PROGRESS for 2s [ 907.494999] env[69232]: INFO networking_nsxv3.common.synchronization [req-1371a20c-1c20-4931-8a9c-990883d3036d req-10e85d75-de59-413a-b0bb-224ea99a53d9 service nova] Enqueued Resource ID: d2391c01-2410-4874-a5a8-6da2d957e88c with Priority: HIGHEST for action security_group_rules [ 907.495220] env[69232]: INFO networking_nsxv3.common.synchronization [req-1371a20c-1c20-4931-8a9c-990883d3036d req-10e85d75-de59-413a-b0bb-224ea99a53d9 service nova] Enqueued Resource ID: d2391c01-2410-4874-a5a8-6da2d957e88c with Priority: HIGHEST for action security_group_members [ 907.495394] env[69232]: INFO networking_nsxv3.common.synchronization [req-1371a20c-1c20-4931-8a9c-990883d3036d req-10e85d75-de59-413a-b0bb-224ea99a53d9 service nova] Enqueued Resource ID: a2540417-6d9d-4985-882b-b4a9bb6b1ee9 with Priority: HIGHEST for action port [ 907.495899] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2391c01-2410-4874-a5a8-6da2d957e88c with Priority: HIGHEST for action security_group_rules [ 907.496042] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2391c01-2410-4874-a5a8-6da2d957e88c with Priority: HIGHEST for action security_group_members [ 907.496139] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2540417-6d9d-4985-882b-b4a9bb6b1ee9 with Priority: HIGHEST for action port [ 907.496432] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d2391c01-2410-4874-a5a8-6da2d957e88c taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.496561] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d2391c01-2410-4874-a5a8-6da2d957e88c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.496623] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d2391c01-2410-4874-a5a8-6da2d957e88c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.496817] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d2391c01-2410-4874-a5a8-6da2d957e88c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.496890] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d2391c01-2410-4874-a5a8-6da2d957e88c',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.499352] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2391c01-2410-4874-a5a8-6da2d957e88c taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.499480] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2391c01-2410-4874-a5a8-6da2d957e88c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.500311] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-a2540417-6d9d-4985-882b-b4a9bb6b1ee9 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.500311] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a2540417-6d9d-4985-882b-b4a9bb6b1ee9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.500311] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a2540417-6d9d-4985-882b-b4a9bb6b1ee9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.500611] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a2540417-6d9d-4985-882b-b4a9bb6b1ee9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.500611] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a2540417-6d9d-4985-882b-b4a9bb6b1ee9',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.657332] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f5186e6-2d35-4ccf-a8b4-749a0a872128 in Status: SUCCESS [ 907.657582] env[69232]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9f5186e6-2d35-4ccf-a8b4-749a0a872128 deletion is rescheduled due to dependency. [ 907.657674] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.000537] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2391c01-2410-4874-a5a8-6da2d957e88c taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.000537] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2391c01-2410-4874-a5a8-6da2d957e88c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.004384] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a2540417-6d9d-4985-882b-b4a9bb6b1ee9 with status ACTIVE [ 908.004384] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.004384] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.004384] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.004384] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.004384] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.004384] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.004384] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.004384] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.004384] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.004799] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.004799] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.004799] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.004799] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.005094] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.005094] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.005094] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a2540417-6d9d-4985-882b-b4a9bb6b1ee9 is going to be updated. [ 908.028044] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.028044] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.028044] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.028317] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.028570] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.028744] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a2540417-6d9d-4985-882b-b4a9bb6b1ee9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.389531] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d2391c01-2410-4874-a5a8-6da2d957e88c in Status: SUCCESS [ 909.391049] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2391c01-2410-4874-a5a8-6da2d957e88c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.391233] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2391c01-2410-4874-a5a8-6da2d957e88c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.391502] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2391c01-2410-4874-a5a8-6da2d957e88c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.391722] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.391875] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.391936] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.392096] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.392193] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.392268] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d2391c01-2410-4874-a5a8-6da2d957e88c',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.894813] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d2391c01-2410-4874-a5a8-6da2d957e88c',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.400304] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d2391c01-2410-4874-a5a8-6da2d957e88c',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.469021] env[69232]: INFO networking_nsxv3.common.synchronization [req-acabe96a-3250-49e9-af6c-d0a5f5e53803 req-d6aa29ac-6bb6-41c0-997e-12d74e1425d8 tempest-ServersTestJSON-524901877 tempest-ServersTestJSON-524901877-project-member] Enqueued Resource ID: bdcc7a21-dd0d-4296-ac34-a880ea6123e7 with Priority: HIGHEST for action security_group_members [ 910.469772] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdcc7a21-dd0d-4296-ac34-a880ea6123e7 with Priority: HIGHEST for action security_group_members [ 910.469989] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.470100] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.470196] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.470420] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.470559] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.470684] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.470746] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.471457] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.471457] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.471457] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bdcc7a21-dd0d-4296-ac34-a880ea6123e7',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.906201] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.906461] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.906621] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.906972] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.907140] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.907308] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d2391c01-2410-4874-a5a8-6da2d957e88c is going to be updated. [ 910.941514] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.941742] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.941852] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.942216] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.942468] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.952507] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d2391c01-2410-4874-a5a8-6da2d957e88c in Status: IN_PROGRESS for 2s [ 910.974089] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bdcc7a21-dd0d-4296-ac34-a880ea6123e7',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.476694] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bdcc7a21-dd0d-4296-ac34-a880ea6123e7',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.979099] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.979371] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.979371] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.979951] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.979951] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.980128] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bdcc7a21-dd0d-4296-ac34-a880ea6123e7 is going to be updated. [ 912.022563] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.022563] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.022563] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.022816] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.022949] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.033720] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bdcc7a21-dd0d-4296-ac34-a880ea6123e7 in Status: IN_PROGRESS for 2s [ 912.963100] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d2391c01-2410-4874-a5a8-6da2d957e88c in Status: SUCCESS [ 912.963534] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2391c01-2410-4874-a5a8-6da2d957e88c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.963534] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2391c01-2410-4874-a5a8-6da2d957e88c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.963757] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2391c01-2410-4874-a5a8-6da2d957e88c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.963980] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.964128] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.964191] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.964330] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.964414] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.964493] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2391c01-2410-4874-a5a8-6da2d957e88c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.964600] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d2391c01-2410-4874-a5a8-6da2d957e88c',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.470935] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2391c01-2410-4874-a5a8-6da2d957e88c taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.471151] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2391c01-2410-4874-a5a8-6da2d957e88c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.471221] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2391c01-2410-4874-a5a8-6da2d957e88c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.471555] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2391c01-2410-4874-a5a8-6da2d957e88c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.471756] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.471875] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.471938] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.472158] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.472239] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.472412] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2391c01-2410-4874-a5a8-6da2d957e88c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.472640] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2391c01-2410-4874-a5a8-6da2d957e88c taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.472815] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2391c01-2410-4874-a5a8-6da2d957e88c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.472955] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2391c01-2410-4874-a5a8-6da2d957e88c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.473325] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2391c01-2410-4874-a5a8-6da2d957e88c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.473325] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.473452] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.473498] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.473714] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.473714] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.474099] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2391c01-2410-4874-a5a8-6da2d957e88c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.474099] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d2391c01-2410-4874-a5a8-6da2d957e88c',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.978167] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d2391c01-2410-4874-a5a8-6da2d957e88c: rpc.has_security_group_logging(os_id): False [ 914.000359] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.000597] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.000738] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.001455] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.026421] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.026746] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.026871] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.026939] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.027217] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.027292] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.027524] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.027631] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.027710] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.027976] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.027976] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.028156] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.028249] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.028325] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.028611] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.028611] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.028677] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d2391c01-2410-4874-a5a8-6da2d957e88c is going to be updated. [ 914.044089] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bdcc7a21-dd0d-4296-ac34-a880ea6123e7 in Status: SUCCESS [ 914.044284] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.101430] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.101430] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.101430] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.101430] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.101430] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.120797] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d2391c01-2410-4874-a5a8-6da2d957e88c in Status: IN_PROGRESS for 2s [ 914.634869] env[69232]: INFO networking_nsxv3.common.synchronization [req-e3218018-6910-4ef6-bce9-8adf33aa92c7 req-f4d6e837-b44d-4546-97be-20209d6992c1 tempest-MigrationsAdminTest-606964981 tempest-MigrationsAdminTest-606964981-project-member] Enqueued Resource ID: 531d0f92-2e98-47df-b32d-d49e1d2f34c1 with Priority: HIGHEST for action security_group_members [ 914.635462] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 531d0f92-2e98-47df-b32d-d49e1d2f34c1 with Priority: HIGHEST for action security_group_members [ 914.635776] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-531d0f92-2e98-47df-b32d-d49e1d2f34c1 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.635902] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-531d0f92-2e98-47df-b32d-d49e1d2f34c1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.635976] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-531d0f92-2e98-47df-b32d-d49e1d2f34c1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.636182] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-531d0f92-2e98-47df-b32d-d49e1d2f34c1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.636334] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.636426] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.636509] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.636821] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.636821] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.636821] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('531d0f92-2e98-47df-b32d-d49e1d2f34c1',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.801248] env[69232]: INFO networking_nsxv3.common.synchronization [req-f53fe2ed-4df3-48a4-b0ec-f31954aee506 req-7011f763-8ed2-4bd0-8f58-f90735a4dc54 tempest-ServerActionsV293TestJSON-86347733 tempest-ServerActionsV293TestJSON-86347733-project-member] Enqueued Resource ID: b5e09fe8-8a4e-445c-b1d3-bf8c7339160c with Priority: HIGHEST for action security_group_members [ 914.801951] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5e09fe8-8a4e-445c-b1d3-bf8c7339160c with Priority: HIGHEST for action security_group_members [ 914.802300] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-b5e09fe8-8a4e-445c-b1d3-bf8c7339160c taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.802526] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b5e09fe8-8a4e-445c-b1d3-bf8c7339160c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.802606] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b5e09fe8-8a4e-445c-b1d3-bf8c7339160c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.802861] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b5e09fe8-8a4e-445c-b1d3-bf8c7339160c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.803549] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.804023] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.804023] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.804023] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.804188] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.804188] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b5e09fe8-8a4e-445c-b1d3-bf8c7339160c',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.141893] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.142363] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.142363] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.142363] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.165318] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.165593] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.165705] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.165769] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.167403] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.167403] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.167403] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 531d0f92-2e98-47df-b32d-d49e1d2f34c1 is going to be updated. [ 915.196885] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.200979] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.200979] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.200979] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.200979] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.212513] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 531d0f92-2e98-47df-b32d-d49e1d2f34c1 in Status: IN_PROGRESS for 2s [ 915.306720] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.306921] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.307240] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.307618] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.307773] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.308117] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.308306] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.308638] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.308795] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.308930] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.309078] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b5e09fe8-8a4e-445c-b1d3-bf8c7339160c already deleted. [ 915.309200] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b5e09fe8-8a4e-445c-b1d3-bf8c7339160c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.448091] env[69232]: INFO networking_nsxv3.common.synchronization [req-5cca31fd-834c-4a70-ba76-590468628328 req-52c2a886-f00a-49c8-ae20-143b96b0d86d tempest-SecurityGroupsTestJSON-1763653160 tempest-SecurityGroupsTestJSON-1763653160-project-member] Enqueued Resource ID: 0a7a78fa-fad0-458c-afc2-e1d98c9176ab with Priority: HIGHEST for action security_group_members [ 915.448276] env[69232]: INFO networking_nsxv3.common.synchronization [req-5cca31fd-834c-4a70-ba76-590468628328 req-52c2a886-f00a-49c8-ae20-143b96b0d86d tempest-SecurityGroupsTestJSON-1763653160 tempest-SecurityGroupsTestJSON-1763653160-project-member] Enqueued Resource ID: b403d6f4-9cfd-407a-9a3f-9a486dae20dc with Priority: HIGHEST for action security_group_members [ 915.448436] env[69232]: INFO networking_nsxv3.common.synchronization [req-5cca31fd-834c-4a70-ba76-590468628328 req-52c2a886-f00a-49c8-ae20-143b96b0d86d tempest-SecurityGroupsTestJSON-1763653160 tempest-SecurityGroupsTestJSON-1763653160-project-member] Enqueued Resource ID: c518d277-32a1-437b-a0b2-37d4c69436b0 with Priority: HIGHEST for action security_group_members [ 915.448959] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a7a78fa-fad0-458c-afc2-e1d98c9176ab with Priority: HIGHEST for action security_group_members [ 915.449135] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b403d6f4-9cfd-407a-9a3f-9a486dae20dc with Priority: HIGHEST for action security_group_members [ 915.449232] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c518d277-32a1-437b-a0b2-37d4c69436b0 with Priority: HIGHEST for action security_group_members [ 915.449534] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.450119] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.450295] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.450577] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.450761] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.450845] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.450939] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.451132] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.451223] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.451317] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0a7a78fa-fad0-458c-afc2-e1d98c9176ab',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.452495] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-b403d6f4-9cfd-407a-9a3f-9a486dae20dc taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.452660] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b403d6f4-9cfd-407a-9a3f-9a486dae20dc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.452735] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b403d6f4-9cfd-407a-9a3f-9a486dae20dc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.452837] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b403d6f4-9cfd-407a-9a3f-9a486dae20dc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.452979] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.453118] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.453182] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.453325] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.453407] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.453499] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b403d6f4-9cfd-407a-9a3f-9a486dae20dc',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.454500] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-c518d277-32a1-437b-a0b2-37d4c69436b0 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.454883] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c518d277-32a1-437b-a0b2-37d4c69436b0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.454883] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c518d277-32a1-437b-a0b2-37d4c69436b0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.455093] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c518d277-32a1-437b-a0b2-37d4c69436b0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.455330] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.455849] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.455967] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.456218] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.456354] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.456503] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c518d277-32a1-437b-a0b2-37d4c69436b0',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.800906] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock network-545 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.801137] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "network-545" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.801268] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "network-545" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.801665] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "network-545" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.801992] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.803386] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.803553] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.803812] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.804078] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.804228] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 915.804354] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] NeedRegenerationException {{(pid=69232) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 915.804464] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] no value, waiting for create lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 915.804631] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] value creation lock acquired {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 915.804694] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 915.804793] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Calling creation function for not-yet-present value {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 915.804934] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 915.826242] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 915.826393] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69232) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 915.826533] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Released creation lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 915.826710] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "network-545" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.827137] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock port-704101be-6e15-42be-b812-4e64121ed6ab taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.827248] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "port-704101be-6e15-42be-b812-4e64121ed6ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.827377] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "port-704101be-6e15-42be-b812-4e64121ed6ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.827711] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "port-704101be-6e15-42be-b812-4e64121ed6ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.827930] env[69232]: DEBUG networking_nsxv3.api.rpc [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('704101be-6e15-42be-b812-4e64121ed6ab',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.962756] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.962934] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.964123] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.965208] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.965316] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.965589] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.965703] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.965773] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.965942] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.966029] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.966121] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a7a78fa-fad0-458c-afc2-e1d98c9176ab is going to be updated. [ 915.967371] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.967504] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.967559] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.967817] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.969143] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.969287] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.995933] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.996310] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.996673] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.996673] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.996821] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.996908] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.997077] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b403d6f4-9cfd-407a-9a3f-9a486dae20dc is going to be updated. [ 915.998126] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.998340] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.020070] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.020344] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.020421] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.021056] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.021056] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.028290] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.028540] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.028666] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.028726] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.028924] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.029332] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.029332] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c518d277-32a1-437b-a0b2-37d4c69436b0 is going to be updated. [ 916.031693] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a7a78fa-fad0-458c-afc2-e1d98c9176ab in Status: IN_PROGRESS for 2s [ 916.053086] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.053330] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.053330] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.053446] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.054024] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.062147] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b403d6f4-9cfd-407a-9a3f-9a486dae20dc in Status: IN_PROGRESS for 2s [ 916.074362] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.074588] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.074588] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.074890] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.075073] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.087268] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c518d277-32a1-437b-a0b2-37d4c69436b0 in Status: IN_PROGRESS for 2s [ 916.146386] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d2391c01-2410-4874-a5a8-6da2d957e88c in Status: SUCCESS [ 916.146386] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d2391c01-2410-4874-a5a8-6da2d957e88c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.333680] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.333882] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.333987] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.334324] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.334721] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.334908] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Segment Port 704101be-6e15-42be-b812-4e64121ed6ab not found, creating... [ 916.335215] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.336021] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.336021] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.336021] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.336021] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.336244] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.336454] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.336542] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.336716] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.336853] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.337015] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Resource: SegmentPort with ID: 704101be-6e15-42be-b812-4e64121ed6ab is going to be created. [ 916.361452] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.361452] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.361452] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.361452] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.361452] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.361452] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "port-704101be-6e15-42be-b812-4e64121ed6ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.230109] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 531d0f92-2e98-47df-b32d-d49e1d2f34c1 in Status: SUCCESS [ 917.230109] env[69232]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 531d0f92-2e98-47df-b32d-d49e1d2f34c1 deletion is rescheduled due to dependency. [ 917.230109] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-531d0f92-2e98-47df-b32d-d49e1d2f34c1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.292800] env[69232]: INFO networking_nsxv3.common.synchronization [req-f53fe2ed-4df3-48a4-b0ec-f31954aee506 req-fa8ac364-6056-4a31-bba3-d67719a6997c service nova] Enqueued Resource ID: b5e09fe8-8a4e-445c-b1d3-bf8c7339160c with Priority: HIGHEST for action security_group_rules [ 917.292900] env[69232]: INFO networking_nsxv3.common.synchronization [req-f53fe2ed-4df3-48a4-b0ec-f31954aee506 req-fa8ac364-6056-4a31-bba3-d67719a6997c service nova] Enqueued Resource ID: b5e09fe8-8a4e-445c-b1d3-bf8c7339160c with Priority: HIGHEST for action security_group_members [ 917.292959] env[69232]: INFO networking_nsxv3.common.synchronization [req-f53fe2ed-4df3-48a4-b0ec-f31954aee506 req-fa8ac364-6056-4a31-bba3-d67719a6997c service nova] Enqueued Resource ID: 704101be-6e15-42be-b812-4e64121ed6ab with Priority: HIGHEST for action port [ 917.295030] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5e09fe8-8a4e-445c-b1d3-bf8c7339160c with Priority: HIGHEST for action security_group_rules [ 917.295030] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5e09fe8-8a4e-445c-b1d3-bf8c7339160c with Priority: HIGHEST for action security_group_members [ 917.295030] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 704101be-6e15-42be-b812-4e64121ed6ab with Priority: HIGHEST for action port [ 917.295030] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b5e09fe8-8a4e-445c-b1d3-bf8c7339160c taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.295030] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b5e09fe8-8a4e-445c-b1d3-bf8c7339160c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.295030] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b5e09fe8-8a4e-445c-b1d3-bf8c7339160c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.295030] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b5e09fe8-8a4e-445c-b1d3-bf8c7339160c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.295030] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b5e09fe8-8a4e-445c-b1d3-bf8c7339160c',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.296404] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-b5e09fe8-8a4e-445c-b1d3-bf8c7339160c taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.296700] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b5e09fe8-8a4e-445c-b1d3-bf8c7339160c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.296700] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b5e09fe8-8a4e-445c-b1d3-bf8c7339160c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.296877] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b5e09fe8-8a4e-445c-b1d3-bf8c7339160c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.296918] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.297029] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.297062] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.297339] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.297339] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.297339] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b5e09fe8-8a4e-445c-b1d3-bf8c7339160c',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.300291] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-704101be-6e15-42be-b812-4e64121ed6ab taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.300291] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-704101be-6e15-42be-b812-4e64121ed6ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.300291] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-704101be-6e15-42be-b812-4e64121ed6ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.300291] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-704101be-6e15-42be-b812-4e64121ed6ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.300291] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('704101be-6e15-42be-b812-4e64121ed6ab',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.537745] env[69232]: INFO networking_nsxv3.common.synchronization [None req-b2175783-c6be-478f-98ab-eefd956458d6 tempest-ServerDiskConfigTestJSON-1562148127 tempest-ServerDiskConfigTestJSON-1562148127-project-member] Enqueued Resource ID: 35fa8bb0-e17f-4534-a6da-6f79ae20707f with Priority: HIGHEST for action security_group_rules [ 917.538361] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 35fa8bb0-e17f-4534-a6da-6f79ae20707f with Priority: HIGHEST for action security_group_rules [ 917.538640] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-35fa8bb0-e17f-4534-a6da-6f79ae20707f taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.538754] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-35fa8bb0-e17f-4534-a6da-6f79ae20707f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.538817] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-35fa8bb0-e17f-4534-a6da-6f79ae20707f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.539092] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-35fa8bb0-e17f-4534-a6da-6f79ae20707f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.539172] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('35fa8bb0-e17f-4534-a6da-6f79ae20707f',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.644157] env[69232]: INFO networking_nsxv3.common.synchronization [None req-e2584e98-b4cc-491a-9608-c40ec6a8db02 tempest-ServerDiskConfigTestJSON-1562148127 tempest-ServerDiskConfigTestJSON-1562148127-project-member] Enqueued Resource ID: 35fa8bb0-e17f-4534-a6da-6f79ae20707f with Priority: HIGHEST for action security_group_rules [ 917.645107] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 35fa8bb0-e17f-4534-a6da-6f79ae20707f with Priority: HIGHEST for action security_group_rules [ 917.645439] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-35fa8bb0-e17f-4534-a6da-6f79ae20707f taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.645547] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-35fa8bb0-e17f-4534-a6da-6f79ae20707f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.797714] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-b5e09fe8-8a4e-445c-b1d3-bf8c7339160c taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.797862] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b5e09fe8-8a4e-445c-b1d3-bf8c7339160c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.801436] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b5e09fe8-8a4e-445c-b1d3-bf8c7339160c',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.802705] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 704101be-6e15-42be-b812-4e64121ed6ab with status ACTIVE [ 917.802966] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.803151] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.803248] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.803923] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.803923] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.803923] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.803923] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.803923] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.804180] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.804180] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.804324] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.804413] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.804466] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.804599] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.804670] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.804749] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 704101be-6e15-42be-b812-4e64121ed6ab is going to be updated. [ 917.828540] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.828762] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.828822] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.828984] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.829719] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.829719] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-704101be-6e15-42be-b812-4e64121ed6ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.043667] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a7a78fa-fad0-458c-afc2-e1d98c9176ab in Status: SUCCESS [ 918.043944] env[69232]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a7a78fa-fad0-458c-afc2-e1d98c9176ab deletion is rescheduled due to dependency. [ 918.044090] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.069455] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.069615] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.069690] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.069987] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.070047] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.070751] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 35fa8bb0-e17f-4534-a6da-6f79ae20707f already deleted. [ 918.070888] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-35fa8bb0-e17f-4534-a6da-6f79ae20707f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.071203] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-35fa8bb0-e17f-4534-a6da-6f79ae20707f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.071451] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-35fa8bb0-e17f-4534-a6da-6f79ae20707f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.071542] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('35fa8bb0-e17f-4534-a6da-6f79ae20707f',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.076313] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b403d6f4-9cfd-407a-9a3f-9a486dae20dc in Status: SUCCESS [ 918.076313] env[69232]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b403d6f4-9cfd-407a-9a3f-9a486dae20dc deletion is rescheduled due to dependency. [ 918.076313] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b403d6f4-9cfd-407a-9a3f-9a486dae20dc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.098953] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c518d277-32a1-437b-a0b2-37d4c69436b0 in Status: IN_PROGRESS for 4s [ 918.307550] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b5e09fe8-8a4e-445c-b1d3-bf8c7339160c',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.600840] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.601049] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.601049] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.601248] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.601351] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.601521] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 35fa8bb0-e17f-4534-a6da-6f79ae20707f already deleted. [ 918.601628] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-35fa8bb0-e17f-4534-a6da-6f79ae20707f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.813868] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.815418] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.815418] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.815418] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.815418] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.815418] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b5e09fe8-8a4e-445c-b1d3-bf8c7339160c is going to be created. [ 918.842063] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.842167] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.842417] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.842521] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.842689] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.853400] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b5e09fe8-8a4e-445c-b1d3-bf8c7339160c in Status: UNINITIALIZED for 2s [ 919.915722] env[69232]: INFO networking_nsxv3.common.synchronization [req-3aa0f53f-8861-4f3d-8557-e0d739500aad req-65eed472-db8e-455d-81f1-163ab8079f0c tempest-ServerRescueTestJSON-1367609634 tempest-ServerRescueTestJSON-1367609634-project-member] Enqueued Resource ID: 15a3e0ef-3467-49d4-a8b2-072fce21b190 with Priority: HIGHEST for action security_group_members [ 919.916242] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15a3e0ef-3467-49d4-a8b2-072fce21b190 with Priority: HIGHEST for action security_group_members [ 919.917089] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-15a3e0ef-3467-49d4-a8b2-072fce21b190 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.917089] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15a3e0ef-3467-49d4-a8b2-072fce21b190" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.917089] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15a3e0ef-3467-49d4-a8b2-072fce21b190" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.917089] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15a3e0ef-3467-49d4-a8b2-072fce21b190" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.922041] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.922041] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.922041] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.922041] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.922041] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.922041] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('15a3e0ef-3467-49d4-a8b2-072fce21b190',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.111169] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c518d277-32a1-437b-a0b2-37d4c69436b0 in Status: SUCCESS [ 920.111614] env[69232]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c518d277-32a1-437b-a0b2-37d4c69436b0 deletion is rescheduled due to dependency. [ 920.112667] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c518d277-32a1-437b-a0b2-37d4c69436b0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.423057] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('15a3e0ef-3467-49d4-a8b2-072fce21b190',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.599945] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock network-700 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.599945] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "network-700" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.599945] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "network-700" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.599945] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "network-700" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.599945] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.599945] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.601571] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.601788] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.601965] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.602222] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 920.602347] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] NeedRegenerationException {{(pid=69232) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 920.602486] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] no value, waiting for create lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 920.602609] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] value creation lock acquired {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 920.602727] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 920.602840] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Calling creation function for not-yet-present value {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 920.602981] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 920.633873] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 920.634631] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Cache value generated in 0.031 seconds for key(s): 'zone-id' {{(pid=69232) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 920.634718] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Released creation lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 920.634924] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "network-700" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.635439] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock port-ba1bf8e3-b66d-4a32-ad54-b5f38f6b3215 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.635947] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "port-ba1bf8e3-b66d-4a32-ad54-b5f38f6b3215" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.636244] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "port-ba1bf8e3-b66d-4a32-ad54-b5f38f6b3215" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.636768] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "port-ba1bf8e3-b66d-4a32-ad54-b5f38f6b3215" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.637024] env[69232]: DEBUG networking_nsxv3.api.rpc [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ba1bf8e3-b66d-4a32-ad54-b5f38f6b3215',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.866821] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b5e09fe8-8a4e-445c-b1d3-bf8c7339160c in Status: SUCCESS [ 920.867103] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b5e09fe8-8a4e-445c-b1d3-bf8c7339160c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.867640] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b5e09fe8-8a4e-445c-b1d3-bf8c7339160c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.867866] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b5e09fe8-8a4e-445c-b1d3-bf8c7339160c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.868081] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.868226] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.868288] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.868467] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.868564] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.868620] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b5e09fe8-8a4e-445c-b1d3-bf8c7339160c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.868704] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b5e09fe8-8a4e-445c-b1d3-bf8c7339160c',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.925031] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('15a3e0ef-3467-49d4-a8b2-072fce21b190',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.934953] env[69232]: INFO networking_nsxv3.common.synchronization [None req-160d52e1-075e-4fa7-9b5b-7015734fc4ab None None] Enqueued Resource ID: 3f70e561-41b3-462f-9515-0064feffe269 with Priority: HIGHEST for action port [ 920.936028] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f70e561-41b3-462f-9515-0064feffe269 with Priority: HIGHEST for action port [ 920.936028] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-3f70e561-41b3-462f-9515-0064feffe269 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.936028] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3f70e561-41b3-462f-9515-0064feffe269" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.936028] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3f70e561-41b3-462f-9515-0064feffe269" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.936266] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3f70e561-41b3-462f-9515-0064feffe269" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.936324] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3f70e561-41b3-462f-9515-0064feffe269',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.142471] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.146024] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.146024] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.146024] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.146024] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.146024] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Segment Port ba1bf8e3-b66d-4a32-ad54-b5f38f6b3215 not found, creating... [ 921.146024] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.146024] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.146024] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.146024] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.146024] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.147338] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.147731] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.148013] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.148360] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.148618] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.148868] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Resource: SegmentPort with ID: ba1bf8e3-b66d-4a32-ad54-b5f38f6b3215 is going to be created. [ 921.176294] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.177407] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.177697] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.178309] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.179023] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.179281] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "port-ba1bf8e3-b66d-4a32-ad54-b5f38f6b3215" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.371535] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b5e09fe8-8a4e-445c-b1d3-bf8c7339160c',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.431798] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.432462] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.432462] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.432462] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.432462] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.432849] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15a3e0ef-3467-49d4-a8b2-072fce21b190 is going to be updated. [ 921.446129] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3f70e561-41b3-462f-9515-0064feffe269 [ 921.446129] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.446129] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.446129] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.446129] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.446129] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.446129] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3f70e561-41b3-462f-9515-0064feffe269 already deleted. [ 921.446824] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3f70e561-41b3-462f-9515-0064feffe269" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.472549] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.472759] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.472842] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.473086] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.473241] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.495043] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15a3e0ef-3467-49d4-a8b2-072fce21b190 in Status: IN_PROGRESS for 2s [ 921.612509] env[69232]: INFO networking_nsxv3.common.synchronization [req-84bfaeed-d701-4f3d-a5d5-970265ba8af8 req-e351f656-4aab-4471-a632-984191e2fd14 tempest-ServerDiskConfigTestJSON-1562148127 tempest-ServerDiskConfigTestJSON-1562148127-project-member] Enqueued Resource ID: 5a45a455-673b-417d-b2f6-be9352c2077e with Priority: HIGHEST for action security_group_members [ 921.612509] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a45a455-673b-417d-b2f6-be9352c2077e with Priority: HIGHEST for action security_group_members [ 921.612795] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a45a455-673b-417d-b2f6-be9352c2077e taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.613071] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a45a455-673b-417d-b2f6-be9352c2077e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.613246] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a45a455-673b-417d-b2f6-be9352c2077e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.613533] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a45a455-673b-417d-b2f6-be9352c2077e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.613825] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.614175] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.614317] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.614561] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.614816] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.615205] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5a45a455-673b-417d-b2f6-be9352c2077e',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.876403] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b5e09fe8-8a4e-445c-b1d3-bf8c7339160c: rpc.has_security_group_logging(os_id): False [ 921.897277] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.900026] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.900026] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.900026] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.900026] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.900026] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.900026] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.900026] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.900026] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.900026] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.900026] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b5e09fe8-8a4e-445c-b1d3-bf8c7339160c is going to be created. [ 921.992257] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.992257] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.992257] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.992257] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.992257] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.013248] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b5e09fe8-8a4e-445c-b1d3-bf8c7339160c in Status: IN_PROGRESS for 2s [ 922.041865] env[69232]: INFO networking_nsxv3.common.synchronization [req-3aa0f53f-8861-4f3d-8557-e0d739500aad req-73acaeed-388e-4de1-b9f3-3d80e5ad7e66 service nova] Enqueued Resource ID: 15a3e0ef-3467-49d4-a8b2-072fce21b190 with Priority: HIGHEST for action security_group_rules [ 922.041865] env[69232]: INFO networking_nsxv3.common.synchronization [req-3aa0f53f-8861-4f3d-8557-e0d739500aad req-73acaeed-388e-4de1-b9f3-3d80e5ad7e66 service nova] Enqueued Resource ID: 15a3e0ef-3467-49d4-a8b2-072fce21b190 with Priority: HIGHEST for action security_group_members [ 922.042051] env[69232]: INFO networking_nsxv3.common.synchronization [req-3aa0f53f-8861-4f3d-8557-e0d739500aad req-73acaeed-388e-4de1-b9f3-3d80e5ad7e66 service nova] Enqueued Resource ID: ba1bf8e3-b66d-4a32-ad54-b5f38f6b3215 with Priority: HIGHEST for action port [ 922.042660] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15a3e0ef-3467-49d4-a8b2-072fce21b190 with Priority: HIGHEST for action security_group_rules [ 922.042937] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15a3e0ef-3467-49d4-a8b2-072fce21b190 with Priority: HIGHEST for action security_group_members [ 922.043029] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba1bf8e3-b66d-4a32-ad54-b5f38f6b3215 with Priority: HIGHEST for action port [ 922.043777] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-15a3e0ef-3467-49d4-a8b2-072fce21b190 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.043966] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-15a3e0ef-3467-49d4-a8b2-072fce21b190" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.044055] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-15a3e0ef-3467-49d4-a8b2-072fce21b190" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.044278] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-15a3e0ef-3467-49d4-a8b2-072fce21b190" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.044394] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('15a3e0ef-3467-49d4-a8b2-072fce21b190',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.045523] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-15a3e0ef-3467-49d4-a8b2-072fce21b190 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.045650] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15a3e0ef-3467-49d4-a8b2-072fce21b190" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.045897] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-ba1bf8e3-b66d-4a32-ad54-b5f38f6b3215 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.046218] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ba1bf8e3-b66d-4a32-ad54-b5f38f6b3215" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.046218] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ba1bf8e3-b66d-4a32-ad54-b5f38f6b3215" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.046419] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ba1bf8e3-b66d-4a32-ad54-b5f38f6b3215" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.046508] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ba1bf8e3-b66d-4a32-ad54-b5f38f6b3215',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.126197] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.127905] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.128118] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.129539] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.135362] env[69232]: INFO networking_nsxv3.common.synchronization [None req-71303135-2da6-4a76-8619-3f4fe6eca787 tempest-ServerActionsTestOtherB-650813181 tempest-ServerActionsTestOtherB-650813181-project-member] Enqueued Resource ID: 934b2684-b99c-4846-87df-66cbae10f2fc with Priority: HIGHEST for action security_group_rules [ 922.136306] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 934b2684-b99c-4846-87df-66cbae10f2fc with Priority: HIGHEST for action security_group_rules [ 922.137114] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-934b2684-b99c-4846-87df-66cbae10f2fc taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.137324] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-934b2684-b99c-4846-87df-66cbae10f2fc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.137429] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-934b2684-b99c-4846-87df-66cbae10f2fc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.138978] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-934b2684-b99c-4846-87df-66cbae10f2fc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.138978] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('934b2684-b99c-4846-87df-66cbae10f2fc',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.181042] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.181042] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.181042] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.181042] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.181042] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.181042] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.181042] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5a45a455-673b-417d-b2f6-be9352c2077e is going to be updated. [ 922.227720] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.227720] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.227720] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.227720] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.227720] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.245878] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a45a455-673b-417d-b2f6-be9352c2077e in Status: IN_PROGRESS for 2s [ 922.288500] env[69232]: INFO networking_nsxv3.common.synchronization [None req-1e9343c7-c3ff-4be8-896a-4a85b9d71fdd tempest-ServerActionsTestOtherB-650813181 tempest-ServerActionsTestOtherB-650813181-project-member] Enqueued Resource ID: 934b2684-b99c-4846-87df-66cbae10f2fc with Priority: HIGHEST for action security_group_rules [ 922.289090] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 934b2684-b99c-4846-87df-66cbae10f2fc with Priority: HIGHEST for action security_group_rules [ 922.289645] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-934b2684-b99c-4846-87df-66cbae10f2fc taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.289768] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-934b2684-b99c-4846-87df-66cbae10f2fc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.549867] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-15a3e0ef-3467-49d4-a8b2-072fce21b190 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.550057] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15a3e0ef-3467-49d4-a8b2-072fce21b190" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.552034] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ba1bf8e3-b66d-4a32-ad54-b5f38f6b3215 with status ACTIVE [ 922.552110] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.552200] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.552251] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.552782] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.552782] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.553081] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.553081] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.553081] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.553256] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.553256] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.553482] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.553610] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.553693] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.553853] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.553978] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.554066] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ba1bf8e3-b66d-4a32-ad54-b5f38f6b3215 is going to be updated. [ 922.584914] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.584914] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.584914] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.584914] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.586419] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.586419] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ba1bf8e3-b66d-4a32-ad54-b5f38f6b3215" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.672836] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.673276] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.673369] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.673580] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.673658] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.673762] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 934b2684-b99c-4846-87df-66cbae10f2fc already deleted. [ 922.673848] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-934b2684-b99c-4846-87df-66cbae10f2fc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.674183] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-934b2684-b99c-4846-87df-66cbae10f2fc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.674383] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-934b2684-b99c-4846-87df-66cbae10f2fc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.674694] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('934b2684-b99c-4846-87df-66cbae10f2fc',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.788108] env[69232]: INFO networking_nsxv3.common.synchronization [req-4632b34a-da22-4ae0-a644-77ebb65b7653 req-37526762-9758-477a-84b3-d73f0fc42370 tempest-ListServerFiltersTestJSON-193943041 tempest-ListServerFiltersTestJSON-193943041-project-member] Enqueued Resource ID: 8f8cfd9d-acc3-4fa8-825d-c583365a30ed with Priority: HIGHEST for action security_group_members [ 922.788626] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f8cfd9d-acc3-4fa8-825d-c583365a30ed with Priority: HIGHEST for action security_group_members [ 922.789009] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f8cfd9d-acc3-4fa8-825d-c583365a30ed taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.789123] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f8cfd9d-acc3-4fa8-825d-c583365a30ed" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.789123] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f8cfd9d-acc3-4fa8-825d-c583365a30ed" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.789387] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f8cfd9d-acc3-4fa8-825d-c583365a30ed" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.789567] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.789660] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.789727] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.790914] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.791116] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.791275] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8f8cfd9d-acc3-4fa8-825d-c583365a30ed',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.211044] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.211044] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.211044] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.211776] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.211776] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.211776] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 934b2684-b99c-4846-87df-66cbae10f2fc already deleted. [ 923.211938] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-934b2684-b99c-4846-87df-66cbae10f2fc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.295556] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.295798] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.295915] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.296264] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.296414] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.296742] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.296918] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.297115] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.297696] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.297696] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.297696] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8f8cfd9d-acc3-4fa8-825d-c583365a30ed already deleted. [ 923.298200] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f8cfd9d-acc3-4fa8-825d-c583365a30ed" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.511817] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15a3e0ef-3467-49d4-a8b2-072fce21b190 in Status: SUCCESS [ 923.512601] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15a3e0ef-3467-49d4-a8b2-072fce21b190" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.512601] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15a3e0ef-3467-49d4-a8b2-072fce21b190" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.512829] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15a3e0ef-3467-49d4-a8b2-072fce21b190" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.512979] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.515957] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.515957] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.515957] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.515957] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.515957] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('15a3e0ef-3467-49d4-a8b2-072fce21b190',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.588030] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock network-513 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.588030] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "network-513" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.588030] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "network-513" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.588030] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "network-513" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.588695] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.589086] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.589453] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.592063] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.592063] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.592063] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 923.592063] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] NeedRegenerationException {{(pid=69232) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 923.592063] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] no value, waiting for create lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 923.592063] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] value creation lock acquired {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 923.592063] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 923.592063] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Calling creation function for not-yet-present value {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 923.592063] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 923.615551] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 923.615810] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=69232) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 923.615909] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Released creation lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 923.616121] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "network-513" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.616495] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock port-452ff98f-4b81-42b4-a1e1-96afef005ee4 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.616697] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "port-452ff98f-4b81-42b4-a1e1-96afef005ee4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.616950] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "port-452ff98f-4b81-42b4-a1e1-96afef005ee4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.617468] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "port-452ff98f-4b81-42b4-a1e1-96afef005ee4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.617650] env[69232]: DEBUG networking_nsxv3.api.rpc [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('452ff98f-4b81-42b4-a1e1-96afef005ee4',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.876771] env[69232]: INFO networking_nsxv3.common.synchronization [None req-670069cd-3aca-43bd-8c03-9ae69b8bbea7 None None] Enqueued Resource ID: 43a69569-a2c8-4442-8fab-28a0cea44bb5 with Priority: HIGHEST for action port [ 923.877572] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43a69569-a2c8-4442-8fab-28a0cea44bb5 with Priority: HIGHEST for action port [ 923.878270] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-43a69569-a2c8-4442-8fab-28a0cea44bb5 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.878515] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-43a69569-a2c8-4442-8fab-28a0cea44bb5" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.878674] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-43a69569-a2c8-4442-8fab-28a0cea44bb5" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.879533] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-43a69569-a2c8-4442-8fab-28a0cea44bb5" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.879722] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('43a69569-a2c8-4442-8fab-28a0cea44bb5',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.017045] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('15a3e0ef-3467-49d4-a8b2-072fce21b190',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.032186] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b5e09fe8-8a4e-445c-b1d3-bf8c7339160c in Status: SUCCESS [ 924.032186] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b5e09fe8-8a4e-445c-b1d3-bf8c7339160c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.121309] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.121638] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.121782] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.122289] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.122541] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.122724] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Segment Port 452ff98f-4b81-42b4-a1e1-96afef005ee4 not found, creating... [ 924.123061] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.123245] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.123397] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.123718] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.123952] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.126557] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.126795] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.126941] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.127274] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.127569] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.127732] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Resource: SegmentPort with ID: 452ff98f-4b81-42b4-a1e1-96afef005ee4 is going to be created. [ 924.160219] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.160499] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.160633] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.160944] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.161212] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.161490] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "port-452ff98f-4b81-42b4-a1e1-96afef005ee4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.263812] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a45a455-673b-417d-b2f6-be9352c2077e in Status: SUCCESS [ 924.264131] env[69232]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5a45a455-673b-417d-b2f6-be9352c2077e deletion is rescheduled due to dependency. [ 924.264334] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a45a455-673b-417d-b2f6-be9352c2077e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.382844] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 43a69569-a2c8-4442-8fab-28a0cea44bb5 [ 924.384386] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.384386] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.385184] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.385184] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.385184] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.385184] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:43a69569-a2c8-4442-8fab-28a0cea44bb5 already deleted. [ 924.385184] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-43a69569-a2c8-4442-8fab-28a0cea44bb5" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.521199] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('15a3e0ef-3467-49d4-a8b2-072fce21b190',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.888854] env[69232]: INFO networking_nsxv3.common.synchronization [req-4632b34a-da22-4ae0-a644-77ebb65b7653 req-a8f9589b-93d2-4fcc-ad6f-e4bd0be67bbb service nova] Enqueued Resource ID: 8f8cfd9d-acc3-4fa8-825d-c583365a30ed with Priority: HIGHEST for action security_group_rules [ 924.889434] env[69232]: INFO networking_nsxv3.common.synchronization [req-4632b34a-da22-4ae0-a644-77ebb65b7653 req-a8f9589b-93d2-4fcc-ad6f-e4bd0be67bbb service nova] Enqueued Resource ID: 8f8cfd9d-acc3-4fa8-825d-c583365a30ed with Priority: HIGHEST for action security_group_members [ 924.889671] env[69232]: INFO networking_nsxv3.common.synchronization [req-4632b34a-da22-4ae0-a644-77ebb65b7653 req-a8f9589b-93d2-4fcc-ad6f-e4bd0be67bbb service nova] Enqueued Resource ID: 452ff98f-4b81-42b4-a1e1-96afef005ee4 with Priority: HIGHEST for action port [ 924.890046] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f8cfd9d-acc3-4fa8-825d-c583365a30ed with Priority: HIGHEST for action security_group_rules [ 924.890187] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f8cfd9d-acc3-4fa8-825d-c583365a30ed with Priority: HIGHEST for action security_group_members [ 924.890286] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 452ff98f-4b81-42b4-a1e1-96afef005ee4 with Priority: HIGHEST for action port [ 924.890869] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8f8cfd9d-acc3-4fa8-825d-c583365a30ed taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.890998] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8f8cfd9d-acc3-4fa8-825d-c583365a30ed" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.891075] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8f8cfd9d-acc3-4fa8-825d-c583365a30ed" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.891332] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8f8cfd9d-acc3-4fa8-825d-c583365a30ed" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.891415] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8f8cfd9d-acc3-4fa8-825d-c583365a30ed',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.892345] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f8cfd9d-acc3-4fa8-825d-c583365a30ed taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.892466] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f8cfd9d-acc3-4fa8-825d-c583365a30ed" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.892533] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f8cfd9d-acc3-4fa8-825d-c583365a30ed" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.892710] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f8cfd9d-acc3-4fa8-825d-c583365a30ed" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.892856] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.893887] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.893887] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.893887] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.893887] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.893887] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8f8cfd9d-acc3-4fa8-825d-c583365a30ed',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.894364] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-452ff98f-4b81-42b4-a1e1-96afef005ee4 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.894364] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-452ff98f-4b81-42b4-a1e1-96afef005ee4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.894364] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-452ff98f-4b81-42b4-a1e1-96afef005ee4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.894491] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-452ff98f-4b81-42b4-a1e1-96afef005ee4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.894564] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('452ff98f-4b81-42b4-a1e1-96afef005ee4',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.024335] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.024535] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.024628] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.024934] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.025163] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.025305] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15a3e0ef-3467-49d4-a8b2-072fce21b190 is going to be updated. [ 925.056723] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.056921] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.057027] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.057271] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.057474] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.069795] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15a3e0ef-3467-49d4-a8b2-072fce21b190 in Status: IN_PROGRESS for 2s [ 925.396389] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8f8cfd9d-acc3-4fa8-825d-c583365a30ed',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.403682] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f8cfd9d-acc3-4fa8-825d-c583365a30ed taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.403682] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f8cfd9d-acc3-4fa8-825d-c583365a30ed" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.404031] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 452ff98f-4b81-42b4-a1e1-96afef005ee4 with status ACTIVE [ 925.404031] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.404031] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.404238] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.404809] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.404809] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.404809] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.404809] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.405149] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.405149] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.405243] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.408433] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.408433] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.408433] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.408433] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.408433] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.408433] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 452ff98f-4b81-42b4-a1e1-96afef005ee4 is going to be updated. [ 925.436213] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.436787] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.436787] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.436787] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.436787] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.436951] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-452ff98f-4b81-42b4-a1e1-96afef005ee4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.690913] env[69232]: INFO networking_nsxv3.common.synchronization [req-74fd0e24-e70d-4e1d-aab5-96dd1dc6941f req-eea83894-d31e-464e-8f63-ca3cf7f4cd91 tempest-ListServerFiltersTestJSON-193943041 tempest-ListServerFiltersTestJSON-193943041-project-member] Enqueued Resource ID: 8f8cfd9d-acc3-4fa8-825d-c583365a30ed with Priority: HIGHEST for action security_group_members [ 925.691597] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f8cfd9d-acc3-4fa8-825d-c583365a30ed with Priority: HIGHEST for action security_group_members [ 925.693517] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f8cfd9d-acc3-4fa8-825d-c583365a30ed taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.693706] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f8cfd9d-acc3-4fa8-825d-c583365a30ed" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.900363] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8f8cfd9d-acc3-4fa8-825d-c583365a30ed',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.404797] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.405579] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.405579] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.405579] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.405579] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.405739] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8f8cfd9d-acc3-4fa8-825d-c583365a30ed is going to be created. [ 926.436829] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.439227] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.439227] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.440043] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.440043] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.451817] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f8cfd9d-acc3-4fa8-825d-c583365a30ed in Status: UNINITIALIZED for 2s [ 926.657116] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock network-513 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.657328] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "network-513" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.657461] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "network-513" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.657745] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "network-513" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.658035] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.658225] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.658309] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.658530] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.658682] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.658890] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 926.659111] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] NeedRegenerationException {{(pid=69232) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 926.662261] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] no value, waiting for create lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 926.662393] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] value creation lock acquired {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 926.663233] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 926.663233] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Calling creation function for not-yet-present value {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 926.663233] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 926.682648] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 926.682843] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69232) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 926.682993] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Released creation lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 926.683208] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "network-513" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.683800] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock port-33e971f7-cc60-480a-8110-76827bba7692 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.683800] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "port-33e971f7-cc60-480a-8110-76827bba7692" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.683966] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "port-33e971f7-cc60-480a-8110-76827bba7692" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.685604] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "port-33e971f7-cc60-480a-8110-76827bba7692" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.685762] env[69232]: DEBUG networking_nsxv3.api.rpc [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('33e971f7-cc60-480a-8110-76827bba7692',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.090213] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15a3e0ef-3467-49d4-a8b2-072fce21b190 in Status: SUCCESS [ 927.090213] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15a3e0ef-3467-49d4-a8b2-072fce21b190" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.090398] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15a3e0ef-3467-49d4-a8b2-072fce21b190" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.090823] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15a3e0ef-3467-49d4-a8b2-072fce21b190" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.090926] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.091059] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.091129] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.091307] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.091395] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.091559] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15a3e0ef-3467-49d4-a8b2-072fce21b190" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.091657] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('15a3e0ef-3467-49d4-a8b2-072fce21b190',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.188626] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.188896] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.189043] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.189374] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.189574] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.189739] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Segment Port 33e971f7-cc60-480a-8110-76827bba7692 not found, creating... [ 927.190046] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.190217] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.190355] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.190588] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.190746] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.191062] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.191231] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.191356] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.191615] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.191813] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.191904] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Resource: SegmentPort with ID: 33e971f7-cc60-480a-8110-76827bba7692 is going to be created. [ 927.213444] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.213687] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.213867] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.214188] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.214437] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.214678] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "port-33e971f7-cc60-480a-8110-76827bba7692" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.594313] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-15a3e0ef-3467-49d4-a8b2-072fce21b190 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.594841] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15a3e0ef-3467-49d4-a8b2-072fce21b190" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.594841] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15a3e0ef-3467-49d4-a8b2-072fce21b190" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.594946] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15a3e0ef-3467-49d4-a8b2-072fce21b190" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.595123] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.595233] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.595305] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.595471] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.595565] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.595652] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15a3e0ef-3467-49d4-a8b2-072fce21b190" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.595825] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-15a3e0ef-3467-49d4-a8b2-072fce21b190 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.595927] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15a3e0ef-3467-49d4-a8b2-072fce21b190" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.595978] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15a3e0ef-3467-49d4-a8b2-072fce21b190" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.596151] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15a3e0ef-3467-49d4-a8b2-072fce21b190" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.596303] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.596399] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.596467] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.596614] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.596694] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.596767] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15a3e0ef-3467-49d4-a8b2-072fce21b190" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.596851] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('15a3e0ef-3467-49d4-a8b2-072fce21b190',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.099299] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 15a3e0ef-3467-49d4-a8b2-072fce21b190: rpc.has_security_group_logging(os_id): False [ 928.120026] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.122071] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.122212] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.122399] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.149259] env[69232]: INFO networking_nsxv3.common.synchronization [req-74fd0e24-e70d-4e1d-aab5-96dd1dc6941f req-5806e549-43db-4037-86de-64167962b0fd service nova] Enqueued Resource ID: 8f8cfd9d-acc3-4fa8-825d-c583365a30ed with Priority: HIGHEST for action security_group_rules [ 928.149259] env[69232]: INFO networking_nsxv3.common.synchronization [req-74fd0e24-e70d-4e1d-aab5-96dd1dc6941f req-5806e549-43db-4037-86de-64167962b0fd service nova] Enqueued Resource ID: 8f8cfd9d-acc3-4fa8-825d-c583365a30ed with Priority: HIGHEST for action security_group_members [ 928.149259] env[69232]: INFO networking_nsxv3.common.synchronization [req-74fd0e24-e70d-4e1d-aab5-96dd1dc6941f req-5806e549-43db-4037-86de-64167962b0fd service nova] Enqueued Resource ID: 33e971f7-cc60-480a-8110-76827bba7692 with Priority: HIGHEST for action port [ 928.149593] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f8cfd9d-acc3-4fa8-825d-c583365a30ed with Priority: HIGHEST for action security_group_rules [ 928.149754] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f8cfd9d-acc3-4fa8-825d-c583365a30ed with Priority: HIGHEST for action security_group_members [ 928.149891] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33e971f7-cc60-480a-8110-76827bba7692 with Priority: HIGHEST for action port [ 928.150351] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8f8cfd9d-acc3-4fa8-825d-c583365a30ed taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.150459] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8f8cfd9d-acc3-4fa8-825d-c583365a30ed" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.150698] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f8cfd9d-acc3-4fa8-825d-c583365a30ed taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.150802] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f8cfd9d-acc3-4fa8-825d-c583365a30ed" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.151069] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-33e971f7-cc60-480a-8110-76827bba7692 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.151183] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-33e971f7-cc60-480a-8110-76827bba7692" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.151250] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-33e971f7-cc60-480a-8110-76827bba7692" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.151545] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-33e971f7-cc60-480a-8110-76827bba7692" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.151655] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('33e971f7-cc60-480a-8110-76827bba7692',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.154446] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.154664] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.154795] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.154863] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.155093] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.155181] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.155758] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.155758] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.155836] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.155980] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.156091] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.160212] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.160212] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.160212] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.160212] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.160212] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.160212] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 15a3e0ef-3467-49d4-a8b2-072fce21b190 is going to be updated. [ 928.211760] env[69232]: INFO networking_nsxv3.common.synchronization [req-274b4744-24ba-4b78-bbbd-69188d558667 req-f37c3c9a-fbdd-4dfb-93e0-dd8937acde99 tempest-ListServerFiltersTestJSON-193943041 tempest-ListServerFiltersTestJSON-193943041-project-member] Enqueued Resource ID: 8f8cfd9d-acc3-4fa8-825d-c583365a30ed with Priority: HIGHEST for action security_group_members [ 928.211760] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f8cfd9d-acc3-4fa8-825d-c583365a30ed with Priority: HIGHEST for action security_group_members [ 928.211760] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f8cfd9d-acc3-4fa8-825d-c583365a30ed taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.211760] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f8cfd9d-acc3-4fa8-825d-c583365a30ed" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.245848] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.246091] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.246170] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.246400] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.246539] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.262866] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 15a3e0ef-3467-49d4-a8b2-072fce21b190 in Status: IN_PROGRESS for 2s [ 928.464516] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f8cfd9d-acc3-4fa8-825d-c583365a30ed in Status: SUCCESS [ 928.464516] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f8cfd9d-acc3-4fa8-825d-c583365a30ed" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.464516] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f8cfd9d-acc3-4fa8-825d-c583365a30ed" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.464793] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f8cfd9d-acc3-4fa8-825d-c583365a30ed" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.465072] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.465366] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.465366] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.465455] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.465533] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.465717] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f8cfd9d-acc3-4fa8-825d-c583365a30ed" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.465784] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8f8cfd9d-acc3-4fa8-825d-c583365a30ed',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.466814] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f8cfd9d-acc3-4fa8-825d-c583365a30ed" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.466814] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f8cfd9d-acc3-4fa8-825d-c583365a30ed" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.467014] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.467202] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.467269] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.468715] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.468715] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.468715] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8f8cfd9d-acc3-4fa8-825d-c583365a30ed',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.591896] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock network-513 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.592312] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "network-513" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.592312] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "network-513" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.592740] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "network-513" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.593097] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.593330] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.593517] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.593804] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.594049] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.594326] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 928.594500] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] NeedRegenerationException {{(pid=69232) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 928.594725] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] no value, waiting for create lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 928.594808] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] value creation lock acquired {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 928.594977] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 928.595145] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Calling creation function for not-yet-present value {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 928.595357] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 928.619608] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 928.619892] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=69232) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 928.620039] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Released creation lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 928.620209] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "network-513" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.620538] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock port-00d01bab-15bf-4747-96ad-4dfc6d3c01bb taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.621157] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "port-00d01bab-15bf-4747-96ad-4dfc6d3c01bb" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.621157] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "port-00d01bab-15bf-4747-96ad-4dfc6d3c01bb" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.621300] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "port-00d01bab-15bf-4747-96ad-4dfc6d3c01bb" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.621371] env[69232]: DEBUG networking_nsxv3.api.rpc [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('00d01bab-15bf-4747-96ad-4dfc6d3c01bb',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.655932] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 33e971f7-cc60-480a-8110-76827bba7692 with status ACTIVE [ 928.655932] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.655932] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.655932] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.655932] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.655932] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.655932] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.655932] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.655932] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.655932] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.655932] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.655932] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.655932] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.655932] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.655932] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.655932] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.655932] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 33e971f7-cc60-480a-8110-76827bba7692 is going to be updated. [ 928.685072] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.685262] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.685262] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.685459] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.685629] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.685811] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-33e971f7-cc60-480a-8110-76827bba7692" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.972778] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f8cfd9d-acc3-4fa8-825d-c583365a30ed taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.972951] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f8cfd9d-acc3-4fa8-825d-c583365a30ed" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.973165] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8f8cfd9d-acc3-4fa8-825d-c583365a30ed',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.126590] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.126828] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.126964] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.127263] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.127408] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.127604] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Segment Port 00d01bab-15bf-4747-96ad-4dfc6d3c01bb not found, creating... [ 929.127984] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.128228] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.128387] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.128611] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.128745] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.129044] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.129200] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.129315] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.129583] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.129729] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.129873] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Resource: SegmentPort with ID: 00d01bab-15bf-4747-96ad-4dfc6d3c01bb is going to be created. [ 929.151069] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.151284] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.151406] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.151933] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.152321] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.152599] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "port-00d01bab-15bf-4747-96ad-4dfc6d3c01bb" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.478657] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8f8cfd9d-acc3-4fa8-825d-c583365a30ed',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.887995] env[69232]: INFO networking_nsxv3.common.synchronization [req-274b4744-24ba-4b78-bbbd-69188d558667 req-aa25643e-c909-4b10-a789-c5773db424d6 service nova] Enqueued Resource ID: 8f8cfd9d-acc3-4fa8-825d-c583365a30ed with Priority: HIGHEST for action security_group_rules [ 929.887995] env[69232]: INFO networking_nsxv3.common.synchronization [req-274b4744-24ba-4b78-bbbd-69188d558667 req-aa25643e-c909-4b10-a789-c5773db424d6 service nova] Enqueued Resource ID: 8f8cfd9d-acc3-4fa8-825d-c583365a30ed with Priority: HIGHEST for action security_group_members [ 929.887995] env[69232]: INFO networking_nsxv3.common.synchronization [req-274b4744-24ba-4b78-bbbd-69188d558667 req-aa25643e-c909-4b10-a789-c5773db424d6 service nova] Enqueued Resource ID: 00d01bab-15bf-4747-96ad-4dfc6d3c01bb with Priority: HIGHEST for action port [ 929.889135] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f8cfd9d-acc3-4fa8-825d-c583365a30ed with Priority: HIGHEST for action security_group_rules [ 929.889135] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f8cfd9d-acc3-4fa8-825d-c583365a30ed with Priority: HIGHEST for action security_group_members [ 929.889135] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00d01bab-15bf-4747-96ad-4dfc6d3c01bb with Priority: HIGHEST for action port [ 929.889269] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8f8cfd9d-acc3-4fa8-825d-c583365a30ed taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.889353] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8f8cfd9d-acc3-4fa8-825d-c583365a30ed" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.889621] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f8cfd9d-acc3-4fa8-825d-c583365a30ed taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.889714] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f8cfd9d-acc3-4fa8-825d-c583365a30ed" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.889917] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-00d01bab-15bf-4747-96ad-4dfc6d3c01bb taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.890141] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-00d01bab-15bf-4747-96ad-4dfc6d3c01bb" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.890141] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-00d01bab-15bf-4747-96ad-4dfc6d3c01bb" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.890340] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-00d01bab-15bf-4747-96ad-4dfc6d3c01bb" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.890424] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('00d01bab-15bf-4747-96ad-4dfc6d3c01bb',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.981381] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.981600] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.981694] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.981886] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.982060] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.982106] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8f8cfd9d-acc3-4fa8-825d-c583365a30ed is going to be updated. [ 930.012088] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.012245] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.012367] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.012697] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.012776] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.023886] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f8cfd9d-acc3-4fa8-825d-c583365a30ed in Status: IN_PROGRESS for 2s [ 930.289427] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 15a3e0ef-3467-49d4-a8b2-072fce21b190 in Status: SUCCESS [ 930.289763] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-15a3e0ef-3467-49d4-a8b2-072fce21b190" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.393429] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 00d01bab-15bf-4747-96ad-4dfc6d3c01bb with status ACTIVE [ 930.393710] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.393851] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.393948] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.394217] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.394325] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.394518] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.394633] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.394706] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.394865] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.394945] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.395183] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.395302] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.395375] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.395567] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.395695] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.395844] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 00d01bab-15bf-4747-96ad-4dfc6d3c01bb is going to be updated. [ 930.429026] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.429026] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.429026] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.429026] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.429026] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.429026] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-00d01bab-15bf-4747-96ad-4dfc6d3c01bb" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.086192] env[69232]: INFO networking_nsxv3.common.synchronization [req-49a9a09e-2721-46c7-967d-9bffb8141a4e req-8c8959f3-c3f6-4313-b524-f535c0ddb41a tempest-AttachVolumeNegativeTest-731570695 tempest-AttachVolumeNegativeTest-731570695-project-member] Enqueued Resource ID: 9dfe0542-c4f4-46ef-bdfa-784cec941ec2 with Priority: HIGHEST for action security_group_members [ 931.086706] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9dfe0542-c4f4-46ef-bdfa-784cec941ec2 with Priority: HIGHEST for action security_group_members [ 931.087768] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-9dfe0542-c4f4-46ef-bdfa-784cec941ec2 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.087768] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9dfe0542-c4f4-46ef-bdfa-784cec941ec2" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.087768] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9dfe0542-c4f4-46ef-bdfa-784cec941ec2" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.087768] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9dfe0542-c4f4-46ef-bdfa-784cec941ec2" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.087768] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.087768] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.087768] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.088102] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.088102] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.089261] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9dfe0542-c4f4-46ef-bdfa-784cec941ec2',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.592275] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.592448] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.592540] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.592779] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.592918] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.593144] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.593528] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.593595] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.594323] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.594469] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.594570] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9dfe0542-c4f4-46ef-bdfa-784cec941ec2 already deleted. [ 931.594668] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9dfe0542-c4f4-46ef-bdfa-784cec941ec2" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.736370] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock network-55 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.736370] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "network-55" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.736370] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "network-55" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.736370] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "network-55" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.736370] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.736370] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.738654] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.739014] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.739194] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.739429] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 931.739554] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] NeedRegenerationException {{(pid=69232) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 931.739673] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] no value, waiting for create lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 931.739790] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] value creation lock acquired {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 931.739907] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 931.740031] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Calling creation function for not-yet-present value {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 931.740259] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 931.762345] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 931.762345] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69232) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 931.763205] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Released creation lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 931.763727] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "network-55" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.764407] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock port-eae9940a-e279-496d-9dfa-5c2bdf5cb09d taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.764812] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "port-eae9940a-e279-496d-9dfa-5c2bdf5cb09d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.764922] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "port-eae9940a-e279-496d-9dfa-5c2bdf5cb09d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.765393] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "port-eae9940a-e279-496d-9dfa-5c2bdf5cb09d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.765597] env[69232]: DEBUG networking_nsxv3.api.rpc [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eae9940a-e279-496d-9dfa-5c2bdf5cb09d',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.855086] env[69232]: INFO networking_nsxv3.common.synchronization [req-1209cac9-f703-4b0a-a74c-52f3ef8d6a65 req-9a67038d-606a-4d50-8566-22eea7975883 tempest-ServersV294TestFqdnHostnames-617930467 tempest-ServersV294TestFqdnHostnames-617930467-project-member] Enqueued Resource ID: 345ff80e-1d3c-4ccc-95f9-bc828bfd5095 with Priority: HIGHEST for action security_group_members [ 931.855735] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 345ff80e-1d3c-4ccc-95f9-bc828bfd5095 with Priority: HIGHEST for action security_group_members [ 931.858267] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-345ff80e-1d3c-4ccc-95f9-bc828bfd5095 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.858445] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-345ff80e-1d3c-4ccc-95f9-bc828bfd5095" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.858559] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-345ff80e-1d3c-4ccc-95f9-bc828bfd5095" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.858839] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-345ff80e-1d3c-4ccc-95f9-bc828bfd5095" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.859097] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.859254] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.859343] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.859698] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.859865] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.859953] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('345ff80e-1d3c-4ccc-95f9-bc828bfd5095',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.043072] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f8cfd9d-acc3-4fa8-825d-c583365a30ed in Status: SUCCESS [ 932.043525] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f8cfd9d-acc3-4fa8-825d-c583365a30ed" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.044456] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f8cfd9d-acc3-4fa8-825d-c583365a30ed" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.044456] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f8cfd9d-acc3-4fa8-825d-c583365a30ed" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.044791] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.044930] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.044998] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.045220] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.045364] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.045547] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8f8cfd9d-acc3-4fa8-825d-c583365a30ed',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.271064] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.271064] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.271064] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.271064] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.271706] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.271706] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Segment Port eae9940a-e279-496d-9dfa-5c2bdf5cb09d not found, creating... [ 932.271706] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.271927] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.272022] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.272257] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.272400] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.272728] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.272893] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.273021] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.273573] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.273573] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.273573] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Resource: SegmentPort with ID: eae9940a-e279-496d-9dfa-5c2bdf5cb09d is going to be created. [ 932.300242] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.300242] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.300242] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.300242] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.300242] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.300242] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "port-eae9940a-e279-496d-9dfa-5c2bdf5cb09d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.362519] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.362715] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.362715] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.363578] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.363578] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.363578] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.363740] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.363853] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.364200] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.364298] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.364516] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 345ff80e-1d3c-4ccc-95f9-bc828bfd5095 is going to be updated. [ 932.403214] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.403214] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.403394] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.403462] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.403616] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.418043] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 345ff80e-1d3c-4ccc-95f9-bc828bfd5095 in Status: IN_PROGRESS for 2s [ 932.547540] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8f8cfd9d-acc3-4fa8-825d-c583365a30ed',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.051533] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8f8cfd9d-acc3-4fa8-825d-c583365a30ed',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.240238] env[69232]: INFO networking_nsxv3.common.synchronization [req-49a9a09e-2721-46c7-967d-9bffb8141a4e req-92cc4cd3-c41c-437a-b41c-483db83495ad service nova] Enqueued Resource ID: 9dfe0542-c4f4-46ef-bdfa-784cec941ec2 with Priority: HIGHEST for action security_group_rules [ 933.240925] env[69232]: INFO networking_nsxv3.common.synchronization [req-49a9a09e-2721-46c7-967d-9bffb8141a4e req-92cc4cd3-c41c-437a-b41c-483db83495ad service nova] Enqueued Resource ID: 9dfe0542-c4f4-46ef-bdfa-784cec941ec2 with Priority: HIGHEST for action security_group_members [ 933.243932] env[69232]: INFO networking_nsxv3.common.synchronization [req-49a9a09e-2721-46c7-967d-9bffb8141a4e req-92cc4cd3-c41c-437a-b41c-483db83495ad service nova] Enqueued Resource ID: eae9940a-e279-496d-9dfa-5c2bdf5cb09d with Priority: HIGHEST for action port [ 933.244520] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9dfe0542-c4f4-46ef-bdfa-784cec941ec2 with Priority: HIGHEST for action security_group_rules [ 933.244665] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9dfe0542-c4f4-46ef-bdfa-784cec941ec2 with Priority: HIGHEST for action security_group_members [ 933.244740] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eae9940a-e279-496d-9dfa-5c2bdf5cb09d with Priority: HIGHEST for action port [ 933.245444] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9dfe0542-c4f4-46ef-bdfa-784cec941ec2 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.245444] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9dfe0542-c4f4-46ef-bdfa-784cec941ec2" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.245444] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9dfe0542-c4f4-46ef-bdfa-784cec941ec2" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.245444] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9dfe0542-c4f4-46ef-bdfa-784cec941ec2" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.245632] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9dfe0542-c4f4-46ef-bdfa-784cec941ec2',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.247599] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-9dfe0542-c4f4-46ef-bdfa-784cec941ec2 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.247599] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9dfe0542-c4f4-46ef-bdfa-784cec941ec2" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.247599] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9dfe0542-c4f4-46ef-bdfa-784cec941ec2" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.247599] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9dfe0542-c4f4-46ef-bdfa-784cec941ec2" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.247961] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.247961] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.248227] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.248307] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.248427] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.249429] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9dfe0542-c4f4-46ef-bdfa-784cec941ec2',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.250604] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-eae9940a-e279-496d-9dfa-5c2bdf5cb09d taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.250811] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-eae9940a-e279-496d-9dfa-5c2bdf5cb09d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.250918] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-eae9940a-e279-496d-9dfa-5c2bdf5cb09d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.251163] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-eae9940a-e279-496d-9dfa-5c2bdf5cb09d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.251282] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eae9940a-e279-496d-9dfa-5c2bdf5cb09d',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.554468] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.554468] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.554468] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.554804] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.555427] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.555427] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8f8cfd9d-acc3-4fa8-825d-c583365a30ed is going to be updated. [ 933.588985] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.589197] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.589324] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.589747] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.589747] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.601856] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f8cfd9d-acc3-4fa8-825d-c583365a30ed in Status: IN_PROGRESS for 2s [ 933.747519] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-9dfe0542-c4f4-46ef-bdfa-784cec941ec2 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.747646] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9dfe0542-c4f4-46ef-bdfa-784cec941ec2" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.756161] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9dfe0542-c4f4-46ef-bdfa-784cec941ec2',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.757173] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port eae9940a-e279-496d-9dfa-5c2bdf5cb09d with status ACTIVE [ 933.758123] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.758123] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.758123] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.758123] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.758123] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.758123] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.758123] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.758536] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.758536] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.758536] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.758722] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.758722] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.759178] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.759178] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.759178] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.759178] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: eae9940a-e279-496d-9dfa-5c2bdf5cb09d is going to be updated. [ 933.800050] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.800360] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.800360] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.800548] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.800706] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.800886] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-eae9940a-e279-496d-9dfa-5c2bdf5cb09d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.261538] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9dfe0542-c4f4-46ef-bdfa-784cec941ec2',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.429507] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 345ff80e-1d3c-4ccc-95f9-bc828bfd5095 in Status: SUCCESS [ 934.429837] env[69232]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 345ff80e-1d3c-4ccc-95f9-bc828bfd5095 deletion is rescheduled due to dependency. [ 934.430032] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-345ff80e-1d3c-4ccc-95f9-bc828bfd5095" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.763943] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.764275] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.764275] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.764449] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.764551] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.764668] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9dfe0542-c4f4-46ef-bdfa-784cec941ec2 is going to be created. [ 934.790202] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.790389] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.790389] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.790629] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.790853] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.802301] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9dfe0542-c4f4-46ef-bdfa-784cec941ec2 in Status: UNINITIALIZED for 2s [ 935.621422] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f8cfd9d-acc3-4fa8-825d-c583365a30ed in Status: SUCCESS [ 935.621802] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f8cfd9d-acc3-4fa8-825d-c583365a30ed" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.622184] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f8cfd9d-acc3-4fa8-825d-c583365a30ed" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.622501] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f8cfd9d-acc3-4fa8-825d-c583365a30ed" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.622739] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.622910] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.623065] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.623346] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.623475] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.623598] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8f8cfd9d-acc3-4fa8-825d-c583365a30ed',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.125988] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8f8cfd9d-acc3-4fa8-825d-c583365a30ed',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.629209] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8f8cfd9d-acc3-4fa8-825d-c583365a30ed',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.812753] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9dfe0542-c4f4-46ef-bdfa-784cec941ec2 in Status: SUCCESS [ 936.812994] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9dfe0542-c4f4-46ef-bdfa-784cec941ec2" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.813184] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9dfe0542-c4f4-46ef-bdfa-784cec941ec2" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.813458] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9dfe0542-c4f4-46ef-bdfa-784cec941ec2" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.813681] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.813847] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.813951] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.814168] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.814265] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.814374] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9dfe0542-c4f4-46ef-bdfa-784cec941ec2" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.814501] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9dfe0542-c4f4-46ef-bdfa-784cec941ec2',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.132368] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.132682] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.132682] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.132930] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.133015] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.133089] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8f8cfd9d-acc3-4fa8-825d-c583365a30ed is going to be updated. [ 937.175719] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.175889] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.176038] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.176217] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.176395] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.187089] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f8cfd9d-acc3-4fa8-825d-c583365a30ed in Status: IN_PROGRESS for 2s [ 937.317459] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9dfe0542-c4f4-46ef-bdfa-784cec941ec2',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.822798] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9dfe0542-c4f4-46ef-bdfa-784cec941ec2: rpc.has_security_group_logging(os_id): False [ 937.842329] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.842329] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.842451] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.842838] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.842838] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.842973] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.844718] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.844718] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.844718] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.844718] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.844718] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9dfe0542-c4f4-46ef-bdfa-784cec941ec2 is going to be created. [ 937.911881] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.911881] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.911881] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.911881] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.911881] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.927016] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9dfe0542-c4f4-46ef-bdfa-784cec941ec2 in Status: IN_PROGRESS for 2s [ 938.245445] env[69232]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 938.245799] env[69232]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=6 [ 939.198552] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f8cfd9d-acc3-4fa8-825d-c583365a30ed in Status: SUCCESS [ 939.198774] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f8cfd9d-acc3-4fa8-825d-c583365a30ed" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.198943] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f8cfd9d-acc3-4fa8-825d-c583365a30ed" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.199173] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f8cfd9d-acc3-4fa8-825d-c583365a30ed" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.199362] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.199571] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.199673] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.199814] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.199896] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.199983] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f8cfd9d-acc3-4fa8-825d-c583365a30ed" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.200176] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f8cfd9d-acc3-4fa8-825d-c583365a30ed taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.200269] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f8cfd9d-acc3-4fa8-825d-c583365a30ed" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.200313] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f8cfd9d-acc3-4fa8-825d-c583365a30ed" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.200452] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f8cfd9d-acc3-4fa8-825d-c583365a30ed" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.200588] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.200685] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.200746] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.200882] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.201010] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.201107] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f8cfd9d-acc3-4fa8-825d-c583365a30ed" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.201194] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8f8cfd9d-acc3-4fa8-825d-c583365a30ed',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.202234] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f8cfd9d-acc3-4fa8-825d-c583365a30ed" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.202431] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f8cfd9d-acc3-4fa8-825d-c583365a30ed" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.202540] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.202677] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.202743] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.202837] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.202927] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.202992] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8f8cfd9d-acc3-4fa8-825d-c583365a30ed',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.705146] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8f8cfd9d-acc3-4fa8-825d-c583365a30ed: rpc.has_security_group_logging(os_id): False [ 939.706693] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8f8cfd9d-acc3-4fa8-825d-c583365a30ed',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.726235] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.726559] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.726681] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.727846] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.727846] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.727846] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.727846] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.727846] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.727846] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.728235] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.728235] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.728235] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.728235] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.728384] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.728473] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.728770] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.728915] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.729010] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.729243] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.729339] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.729479] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8f8cfd9d-acc3-4fa8-825d-c583365a30ed is going to be created. [ 939.793628] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.794202] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.794202] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.794202] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.794400] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.807762] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8f8cfd9d-acc3-4fa8-825d-c583365a30ed in Status: IN_PROGRESS for 2s [ 939.942440] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9dfe0542-c4f4-46ef-bdfa-784cec941ec2 in Status: SUCCESS [ 939.944324] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9dfe0542-c4f4-46ef-bdfa-784cec941ec2" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.209556] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8f8cfd9d-acc3-4fa8-825d-c583365a30ed',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.715838] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.716162] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.716162] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.720225] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.720225] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.720225] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8f8cfd9d-acc3-4fa8-825d-c583365a30ed is going to be updated. [ 940.751572] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.751835] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.751901] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.752187] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.752370] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.763366] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f8cfd9d-acc3-4fa8-825d-c583365a30ed in Status: IN_PROGRESS for 2s [ 941.011561] env[69232]: INFO networking_nsxv3.common.synchronization [req-6b523211-51bb-4444-aca0-b0cf38c83b6a req-63ea687e-cc04-4c47-abbc-6a85569adb0a tempest-ServersTestBootFromVolume-980609594 tempest-ServersTestBootFromVolume-980609594-project-member] Enqueued Resource ID: 45780cba-cd94-4a19-b7a8-aa324fdcb9c5 with Priority: HIGHEST for action security_group_members [ 941.011811] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45780cba-cd94-4a19-b7a8-aa324fdcb9c5 with Priority: HIGHEST for action security_group_members [ 941.012388] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-45780cba-cd94-4a19-b7a8-aa324fdcb9c5 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.012524] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45780cba-cd94-4a19-b7a8-aa324fdcb9c5" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.012684] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45780cba-cd94-4a19-b7a8-aa324fdcb9c5" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.012856] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45780cba-cd94-4a19-b7a8-aa324fdcb9c5" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.013048] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.013151] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.013405] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.013596] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.013685] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.013782] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('45780cba-cd94-4a19-b7a8-aa324fdcb9c5',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.516764] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.516923] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.516992] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.517253] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.543581] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.543884] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.544013] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.545316] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.545636] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.545764] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.545872] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 45780cba-cd94-4a19-b7a8-aa324fdcb9c5 is going to be updated. [ 941.583044] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.583296] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.583296] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.583476] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.583615] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.593607] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 45780cba-cd94-4a19-b7a8-aa324fdcb9c5 in Status: IN_PROGRESS for 2s [ 941.827420] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8f8cfd9d-acc3-4fa8-825d-c583365a30ed in Status: SUCCESS [ 941.830068] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8f8cfd9d-acc3-4fa8-825d-c583365a30ed" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.830068] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8f8cfd9d-acc3-4fa8-825d-c583365a30ed" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.830068] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8f8cfd9d-acc3-4fa8-825d-c583365a30ed" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.830068] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8f8cfd9d-acc3-4fa8-825d-c583365a30ed',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.334457] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f8cfd9d-acc3-4fa8-825d-c583365a30ed taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.335149] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f8cfd9d-acc3-4fa8-825d-c583365a30ed" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.785365] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f8cfd9d-acc3-4fa8-825d-c583365a30ed in Status: SUCCESS [ 942.785607] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f8cfd9d-acc3-4fa8-825d-c583365a30ed" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.785788] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f8cfd9d-acc3-4fa8-825d-c583365a30ed" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.786018] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f8cfd9d-acc3-4fa8-825d-c583365a30ed" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.786223] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.786341] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.786407] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.786567] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.786649] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.786733] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f8cfd9d-acc3-4fa8-825d-c583365a30ed" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.786822] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8f8cfd9d-acc3-4fa8-825d-c583365a30ed',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.290533] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f8cfd9d-acc3-4fa8-825d-c583365a30ed taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.290845] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f8cfd9d-acc3-4fa8-825d-c583365a30ed" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.290845] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f8cfd9d-acc3-4fa8-825d-c583365a30ed" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.290981] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f8cfd9d-acc3-4fa8-825d-c583365a30ed" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.291170] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.291271] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.291338] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.291493] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.291587] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.291748] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f8cfd9d-acc3-4fa8-825d-c583365a30ed" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.291897] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f8cfd9d-acc3-4fa8-825d-c583365a30ed taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.291991] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f8cfd9d-acc3-4fa8-825d-c583365a30ed" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.292068] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f8cfd9d-acc3-4fa8-825d-c583365a30ed" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.292256] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f8cfd9d-acc3-4fa8-825d-c583365a30ed" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.292344] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.292434] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.292494] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.292630] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.292720] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.292813] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f8cfd9d-acc3-4fa8-825d-c583365a30ed" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.292905] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8f8cfd9d-acc3-4fa8-825d-c583365a30ed',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.604657] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 45780cba-cd94-4a19-b7a8-aa324fdcb9c5 in Status: SUCCESS [ 943.604857] env[69232]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 45780cba-cd94-4a19-b7a8-aa324fdcb9c5 deletion is rescheduled due to dependency. [ 943.605282] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45780cba-cd94-4a19-b7a8-aa324fdcb9c5" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.756224] env[69232]: INFO networking_nsxv3.common.synchronization [req-c4c6435c-324c-41bb-b5e1-15399fb70378 req-d8c3aee7-30f1-45a6-8173-49be947a15fd tempest-ServerDiskConfigTestJSON-1562148127 tempest-ServerDiskConfigTestJSON-1562148127-project-member] Enqueued Resource ID: 5a45a455-673b-417d-b2f6-be9352c2077e with Priority: HIGHEST for action security_group_members [ 943.756801] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a45a455-673b-417d-b2f6-be9352c2077e with Priority: HIGHEST for action security_group_members [ 943.757199] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a45a455-673b-417d-b2f6-be9352c2077e taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.757288] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a45a455-673b-417d-b2f6-be9352c2077e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.757343] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a45a455-673b-417d-b2f6-be9352c2077e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.757514] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a45a455-673b-417d-b2f6-be9352c2077e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.757667] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.757769] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.757828] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.757976] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.761410] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.761410] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5a45a455-673b-417d-b2f6-be9352c2077e',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.797071] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8f8cfd9d-acc3-4fa8-825d-c583365a30ed: rpc.has_security_group_logging(os_id): False [ 943.823386] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.823589] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.823589] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.823972] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.823972] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.824109] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.824274] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.824274] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.824425] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.824504] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.824691] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.824788] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.824851] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.824996] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.825079] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.825285] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.825372] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.825464] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.827918] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.827918] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.828097] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8f8cfd9d-acc3-4fa8-825d-c583365a30ed is going to be updated. [ 943.965721] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.965861] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.965861] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.967190] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.967190] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.010043] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8f8cfd9d-acc3-4fa8-825d-c583365a30ed in Status: IN_PROGRESS for 2s [ 944.234986] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock network-846 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.234986] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "network-846" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.236587] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "network-846" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.236587] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "network-846" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.236587] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.236587] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.236800] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.237179] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.237179] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.237347] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 944.237464] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] NeedRegenerationException {{(pid=69232) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 944.237575] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] no value, waiting for create lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 944.237691] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] value creation lock acquired {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 944.239281] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 944.239281] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Calling creation function for not-yet-present value {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 944.239281] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 944.267307] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.267307] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.267307] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.267307] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.267307] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.267307] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.267307] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.267307] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.267307] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.267307] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.267307] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5a45a455-673b-417d-b2f6-be9352c2077e is going to be updated. [ 944.271197] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 944.271197] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Cache value generated in 0.032 seconds for key(s): 'zone-id' {{(pid=69232) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 944.271197] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Released creation lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 944.271197] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "network-846" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.271197] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock port-a6f178ff-89bb-46ce-9710-f4ce4733c839 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.271197] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "port-a6f178ff-89bb-46ce-9710-f4ce4733c839" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.271197] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "port-a6f178ff-89bb-46ce-9710-f4ce4733c839" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.273302] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "port-a6f178ff-89bb-46ce-9710-f4ce4733c839" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.273302] env[69232]: DEBUG networking_nsxv3.api.rpc [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a6f178ff-89bb-46ce-9710-f4ce4733c839',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.302651] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.303360] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.303602] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.303929] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.305081] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.322220] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a45a455-673b-417d-b2f6-be9352c2077e in Status: IN_PROGRESS for 2s [ 944.779963] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.780261] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.780433] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.780748] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.780914] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.781088] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Segment Port a6f178ff-89bb-46ce-9710-f4ce4733c839 not found, creating... [ 944.781362] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.782451] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.782451] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.782451] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.782451] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.782451] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.782856] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.782856] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.783064] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.783108] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.783668] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Resource: SegmentPort with ID: a6f178ff-89bb-46ce-9710-f4ce4733c839 is going to be created. [ 944.808152] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.808422] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.808422] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.808704] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.809054] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.809248] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "port-a6f178ff-89bb-46ce-9710-f4ce4733c839" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.665682] env[69232]: INFO networking_nsxv3.common.synchronization [req-c4c6435c-324c-41bb-b5e1-15399fb70378 req-1270fd95-e58c-4a10-94e3-6901bbb949c3 service nova] Enqueued Resource ID: 5a45a455-673b-417d-b2f6-be9352c2077e with Priority: HIGHEST for action security_group_rules [ 945.668353] env[69232]: INFO networking_nsxv3.common.synchronization [req-c4c6435c-324c-41bb-b5e1-15399fb70378 req-1270fd95-e58c-4a10-94e3-6901bbb949c3 service nova] Enqueued Resource ID: 5a45a455-673b-417d-b2f6-be9352c2077e with Priority: HIGHEST for action security_group_members [ 945.668902] env[69232]: INFO networking_nsxv3.common.synchronization [req-c4c6435c-324c-41bb-b5e1-15399fb70378 req-1270fd95-e58c-4a10-94e3-6901bbb949c3 service nova] Enqueued Resource ID: a6f178ff-89bb-46ce-9710-f4ce4733c839 with Priority: HIGHEST for action port [ 945.669339] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a45a455-673b-417d-b2f6-be9352c2077e with Priority: HIGHEST for action security_group_rules [ 945.669567] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a45a455-673b-417d-b2f6-be9352c2077e with Priority: HIGHEST for action security_group_members [ 945.669756] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6f178ff-89bb-46ce-9710-f4ce4733c839 with Priority: HIGHEST for action port [ 945.670256] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5a45a455-673b-417d-b2f6-be9352c2077e taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.670690] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5a45a455-673b-417d-b2f6-be9352c2077e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.670690] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5a45a455-673b-417d-b2f6-be9352c2077e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.670902] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5a45a455-673b-417d-b2f6-be9352c2077e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.671045] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5a45a455-673b-417d-b2f6-be9352c2077e',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.672417] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a45a455-673b-417d-b2f6-be9352c2077e taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.672592] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a45a455-673b-417d-b2f6-be9352c2077e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.672949] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-a6f178ff-89bb-46ce-9710-f4ce4733c839 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.673163] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a6f178ff-89bb-46ce-9710-f4ce4733c839" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.673282] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a6f178ff-89bb-46ce-9710-f4ce4733c839" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.673600] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a6f178ff-89bb-46ce-9710-f4ce4733c839" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.673735] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a6f178ff-89bb-46ce-9710-f4ce4733c839',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.024935] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8f8cfd9d-acc3-4fa8-825d-c583365a30ed in Status: SUCCESS [ 946.025087] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8f8cfd9d-acc3-4fa8-825d-c583365a30ed" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.025279] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8f8cfd9d-acc3-4fa8-825d-c583365a30ed" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.025505] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8f8cfd9d-acc3-4fa8-825d-c583365a30ed" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.025594] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8f8cfd9d-acc3-4fa8-825d-c583365a30ed',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.178909] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a45a455-673b-417d-b2f6-be9352c2077e taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.179167] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a45a455-673b-417d-b2f6-be9352c2077e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.179504] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a6f178ff-89bb-46ce-9710-f4ce4733c839 with status ACTIVE [ 946.179792] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.180084] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.180165] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.180471] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.180640] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.180921] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.181125] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.181241] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.181759] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.181759] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.181979] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.184923] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.185123] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.185439] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.186700] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.186911] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a6f178ff-89bb-46ce-9710-f4ce4733c839 is going to be updated. [ 946.213212] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.213212] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.213212] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.213212] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.213212] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.213212] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a6f178ff-89bb-46ce-9710-f4ce4733c839" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.367216] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a45a455-673b-417d-b2f6-be9352c2077e in Status: SUCCESS [ 946.367398] env[69232]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5a45a455-673b-417d-b2f6-be9352c2077e deletion is rescheduled due to dependency. [ 946.367506] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a45a455-673b-417d-b2f6-be9352c2077e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.367714] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a45a455-673b-417d-b2f6-be9352c2077e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.368016] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a45a455-673b-417d-b2f6-be9352c2077e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.368803] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.368803] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.368803] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.368803] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.368803] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.368803] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5a45a455-673b-417d-b2f6-be9352c2077e',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.477480] env[69232]: INFO networking_nsxv3.common.synchronization [req-f6b152cc-ab15-4295-9330-99376b730deb req-08f3f514-602e-421a-8c5b-845ce695b0dd tempest-ImagesTestJSON-1245210724 tempest-ImagesTestJSON-1245210724-project-member] Enqueued Resource ID: fb3494b9-4ce5-4744-a378-ecbcd5c2bec9 with Priority: HIGHEST for action security_group_members [ 946.478051] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb3494b9-4ce5-4744-a378-ecbcd5c2bec9 with Priority: HIGHEST for action security_group_members [ 946.479264] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.479264] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.479264] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.479264] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.480622] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.480622] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.480622] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.481146] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.481146] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.481146] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fb3494b9-4ce5-4744-a378-ecbcd5c2bec9',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.528258] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f8cfd9d-acc3-4fa8-825d-c583365a30ed taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.528422] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f8cfd9d-acc3-4fa8-825d-c583365a30ed" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.528498] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f8cfd9d-acc3-4fa8-825d-c583365a30ed" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.529746] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f8cfd9d-acc3-4fa8-825d-c583365a30ed" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.530010] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.530687] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.530687] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.530687] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.530687] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.532040] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f8cfd9d-acc3-4fa8-825d-c583365a30ed" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.532040] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8f8cfd9d-acc3-4fa8-825d-c583365a30ed',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.872607] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5a45a455-673b-417d-b2f6-be9352c2077e',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.902560] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock network-674 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.903418] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "network-674" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.903700] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "network-674" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.904079] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "network-674" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.904450] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.904691] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.909025] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.909025] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.909025] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.909025] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 946.909025] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] NeedRegenerationException {{(pid=69232) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 946.909025] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] no value, waiting for create lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 946.909025] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] value creation lock acquired {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 946.909025] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 946.909025] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Calling creation function for not-yet-present value {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 946.909025] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 946.934179] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 946.934179] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=69232) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 946.934179] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Released creation lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 946.934179] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "network-674" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.934179] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock port-f0ba55ce-e5e7-42a2-bc3d-ccf4190cccd8 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.934179] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "port-f0ba55ce-e5e7-42a2-bc3d-ccf4190cccd8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.934179] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "port-f0ba55ce-e5e7-42a2-bc3d-ccf4190cccd8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.934654] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "port-f0ba55ce-e5e7-42a2-bc3d-ccf4190cccd8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.934878] env[69232]: DEBUG networking_nsxv3.api.rpc [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f0ba55ce-e5e7-42a2-bc3d-ccf4190cccd8',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.982920] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fb3494b9-4ce5-4744-a378-ecbcd5c2bec9',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.037742] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f8cfd9d-acc3-4fa8-825d-c583365a30ed taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.037742] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f8cfd9d-acc3-4fa8-825d-c583365a30ed" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.037742] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f8cfd9d-acc3-4fa8-825d-c583365a30ed" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.037742] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f8cfd9d-acc3-4fa8-825d-c583365a30ed" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.037742] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.037742] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.038131] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.038131] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.042114] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.043128] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f8cfd9d-acc3-4fa8-825d-c583365a30ed" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.043128] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f8cfd9d-acc3-4fa8-825d-c583365a30ed taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.043128] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f8cfd9d-acc3-4fa8-825d-c583365a30ed" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.043128] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f8cfd9d-acc3-4fa8-825d-c583365a30ed" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.043128] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f8cfd9d-acc3-4fa8-825d-c583365a30ed" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.043128] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.043632] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.043632] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.043632] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.043632] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.043882] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f8cfd9d-acc3-4fa8-825d-c583365a30ed" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.043882] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8f8cfd9d-acc3-4fa8-825d-c583365a30ed',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.375183] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5a45a455-673b-417d-b2f6-be9352c2077e',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.437619] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.438532] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.438705] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.440065] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.440065] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.440065] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Segment Port f0ba55ce-e5e7-42a2-bc3d-ccf4190cccd8 not found, creating... [ 947.440065] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.440314] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.440882] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.441553] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.441833] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.442349] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.442349] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.442457] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.442741] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.442922] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.443059] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Resource: SegmentPort with ID: f0ba55ce-e5e7-42a2-bc3d-ccf4190cccd8 is going to be created. [ 947.472105] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.472376] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.472472] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.472803] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.473088] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.473337] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "port-f0ba55ce-e5e7-42a2-bc3d-ccf4190cccd8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.484920] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fb3494b9-4ce5-4744-a378-ecbcd5c2bec9',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.546646] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8f8cfd9d-acc3-4fa8-825d-c583365a30ed: rpc.has_security_group_logging(os_id): False [ 947.584246] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.584356] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.584356] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.584582] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.584675] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.585602] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.585602] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.585602] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.585602] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.585602] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.585602] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.585602] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.585602] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.586341] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.586341] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.586432] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.586588] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.586719] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.586932] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.587054] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.587173] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8f8cfd9d-acc3-4fa8-825d-c583365a30ed is going to be updated. [ 947.695118] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.695370] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.695370] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.695629] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.695761] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.720811] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8f8cfd9d-acc3-4fa8-825d-c583365a30ed in Status: IN_PROGRESS for 2s [ 947.877983] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.878412] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.878412] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.878519] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.878519] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.878666] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5a45a455-673b-417d-b2f6-be9352c2077e is going to be updated. [ 947.918487] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.918487] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.918487] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.918487] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.918487] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.930128] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a45a455-673b-417d-b2f6-be9352c2077e in Status: IN_PROGRESS for 2s [ 947.993226] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.993226] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.993226] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.993226] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.993226] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.993226] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb3494b9-4ce5-4744-a378-ecbcd5c2bec9 is going to be updated. [ 948.031903] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.032182] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.032308] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.032560] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.032742] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.045546] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb3494b9-4ce5-4744-a378-ecbcd5c2bec9 in Status: IN_PROGRESS for 2s [ 948.351180] env[69232]: INFO networking_nsxv3.common.synchronization [None req-11ab6b64-a8b8-4150-8ed5-a616553ac0b3 None None] Enqueued Resource ID: 5abd686e-cb69-4e48-ab99-41e34be9c7f4 with Priority: HIGHEST for action port [ 948.351180] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5abd686e-cb69-4e48-ab99-41e34be9c7f4 with Priority: HIGHEST for action port [ 948.351590] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-5abd686e-cb69-4e48-ab99-41e34be9c7f4 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.351774] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5abd686e-cb69-4e48-ab99-41e34be9c7f4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.351837] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5abd686e-cb69-4e48-ab99-41e34be9c7f4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.352466] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5abd686e-cb69-4e48-ab99-41e34be9c7f4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.352606] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5abd686e-cb69-4e48-ab99-41e34be9c7f4',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.396452] env[69232]: INFO networking_nsxv3.common.synchronization [req-f6b152cc-ab15-4295-9330-99376b730deb req-25182f4e-c2c7-49fa-b4d0-d96f96c17b02 service nova] Enqueued Resource ID: fb3494b9-4ce5-4744-a378-ecbcd5c2bec9 with Priority: HIGHEST for action security_group_rules [ 948.396452] env[69232]: INFO networking_nsxv3.common.synchronization [req-f6b152cc-ab15-4295-9330-99376b730deb req-25182f4e-c2c7-49fa-b4d0-d96f96c17b02 service nova] Enqueued Resource ID: fb3494b9-4ce5-4744-a378-ecbcd5c2bec9 with Priority: HIGHEST for action security_group_members [ 948.396452] env[69232]: INFO networking_nsxv3.common.synchronization [req-f6b152cc-ab15-4295-9330-99376b730deb req-25182f4e-c2c7-49fa-b4d0-d96f96c17b02 service nova] Enqueued Resource ID: f0ba55ce-e5e7-42a2-bc3d-ccf4190cccd8 with Priority: HIGHEST for action port [ 948.396452] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb3494b9-4ce5-4744-a378-ecbcd5c2bec9 with Priority: HIGHEST for action security_group_rules [ 948.396452] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb3494b9-4ce5-4744-a378-ecbcd5c2bec9 with Priority: HIGHEST for action security_group_members [ 948.396974] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f0ba55ce-e5e7-42a2-bc3d-ccf4190cccd8 with Priority: HIGHEST for action port [ 948.397980] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.397980] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.397980] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.398433] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.398543] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fb3494b9-4ce5-4744-a378-ecbcd5c2bec9',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.405832] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.405832] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.406454] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-f0ba55ce-e5e7-42a2-bc3d-ccf4190cccd8 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.406454] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f0ba55ce-e5e7-42a2-bc3d-ccf4190cccd8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.406454] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f0ba55ce-e5e7-42a2-bc3d-ccf4190cccd8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.406710] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f0ba55ce-e5e7-42a2-bc3d-ccf4190cccd8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.406710] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f0ba55ce-e5e7-42a2-bc3d-ccf4190cccd8',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.856261] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5abd686e-cb69-4e48-ab99-41e34be9c7f4 [ 948.856795] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.857791] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.857791] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.858276] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.859204] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.859359] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5abd686e-cb69-4e48-ab99-41e34be9c7f4 already deleted. [ 948.859469] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5abd686e-cb69-4e48-ab99-41e34be9c7f4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.905399] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.905781] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.910387] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f0ba55ce-e5e7-42a2-bc3d-ccf4190cccd8 with status ACTIVE [ 948.910711] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.910866] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.910936] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.911440] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.911440] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.911608] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.911719] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.911719] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.911884] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.912128] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.912190] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.913612] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.913612] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.913612] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.913612] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.913612] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f0ba55ce-e5e7-42a2-bc3d-ccf4190cccd8 is going to be updated. [ 948.941825] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.941825] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.941825] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.941825] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.941825] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.941825] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f0ba55ce-e5e7-42a2-bc3d-ccf4190cccd8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.322902] env[69232]: INFO networking_nsxv3.common.synchronization [req-9094f0c2-fe78-47c8-8721-ea96929a7577 req-af853b8f-3a71-4a7e-b261-d5adb87c4d0f tempest-ServersAdminTestJSON-2143393640 tempest-ServersAdminTestJSON-2143393640-project-member] Enqueued Resource ID: d2391c01-2410-4874-a5a8-6da2d957e88c with Priority: HIGHEST for action security_group_members [ 949.322902] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2391c01-2410-4874-a5a8-6da2d957e88c with Priority: HIGHEST for action security_group_members [ 949.323144] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2391c01-2410-4874-a5a8-6da2d957e88c taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.323261] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2391c01-2410-4874-a5a8-6da2d957e88c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.323297] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2391c01-2410-4874-a5a8-6da2d957e88c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.323475] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2391c01-2410-4874-a5a8-6da2d957e88c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.323619] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.324795] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.324795] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.324795] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.324795] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.324795] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d2391c01-2410-4874-a5a8-6da2d957e88c',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.744710] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8f8cfd9d-acc3-4fa8-825d-c583365a30ed in Status: SUCCESS [ 949.744710] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8f8cfd9d-acc3-4fa8-825d-c583365a30ed" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.831502] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d2391c01-2410-4874-a5a8-6da2d957e88c',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.940878] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a45a455-673b-417d-b2f6-be9352c2077e in Status: SUCCESS [ 949.941269] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a45a455-673b-417d-b2f6-be9352c2077e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.941451] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a45a455-673b-417d-b2f6-be9352c2077e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.941695] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a45a455-673b-417d-b2f6-be9352c2077e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.941906] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.942043] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.942101] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.942283] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.942370] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.942457] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a45a455-673b-417d-b2f6-be9352c2077e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.942551] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5a45a455-673b-417d-b2f6-be9352c2077e',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.057546] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb3494b9-4ce5-4744-a378-ecbcd5c2bec9 in Status: SUCCESS [ 950.057818] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.058132] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.058812] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.058812] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.058812] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.058812] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.058972] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.058972] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.059050] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fb3494b9-4ce5-4744-a378-ecbcd5c2bec9',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.335189] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d2391c01-2410-4874-a5a8-6da2d957e88c',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.445618] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a45a455-673b-417d-b2f6-be9352c2077e taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.446604] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a45a455-673b-417d-b2f6-be9352c2077e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.446604] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a45a455-673b-417d-b2f6-be9352c2077e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.446604] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a45a455-673b-417d-b2f6-be9352c2077e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.446813] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.446959] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.446959] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.447324] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.447451] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.447588] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a45a455-673b-417d-b2f6-be9352c2077e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.449124] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a45a455-673b-417d-b2f6-be9352c2077e taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.449124] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a45a455-673b-417d-b2f6-be9352c2077e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.449124] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a45a455-673b-417d-b2f6-be9352c2077e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.449593] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a45a455-673b-417d-b2f6-be9352c2077e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.450056] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.450144] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.450200] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.450480] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.450572] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.450686] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a45a455-673b-417d-b2f6-be9352c2077e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.450783] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5a45a455-673b-417d-b2f6-be9352c2077e',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.562841] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fb3494b9-4ce5-4744-a378-ecbcd5c2bec9',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.801817] env[69232]: INFO networking_nsxv3.common.synchronization [None req-0a4685b6-9535-4556-a17d-abd303e824df None None] Enqueued Resource ID: 2d79fcdc-6c74-408a-b3fe-b8980eeb1219 with Priority: HIGHEST for action port [ 950.802380] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d79fcdc-6c74-408a-b3fe-b8980eeb1219 with Priority: HIGHEST for action port [ 950.802725] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-2d79fcdc-6c74-408a-b3fe-b8980eeb1219 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.802880] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2d79fcdc-6c74-408a-b3fe-b8980eeb1219" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.802981] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2d79fcdc-6c74-408a-b3fe-b8980eeb1219" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.803890] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2d79fcdc-6c74-408a-b3fe-b8980eeb1219" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.804065] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2d79fcdc-6c74-408a-b3fe-b8980eeb1219',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.840594] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.841228] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.843027] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.843027] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.843027] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.843027] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d2391c01-2410-4874-a5a8-6da2d957e88c is going to be updated. [ 950.885498] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.885998] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.885998] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.886136] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.887558] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.897499] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d2391c01-2410-4874-a5a8-6da2d957e88c in Status: IN_PROGRESS for 2s [ 950.958532] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5a45a455-673b-417d-b2f6-be9352c2077e: rpc.has_security_group_logging(os_id): False [ 950.983126] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.983126] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.983126] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.984622] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.984834] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.985478] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.985828] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.986548] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.986837] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.987035] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.987375] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.987594] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.987774] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.988108] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.988163] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.988574] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.988755] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.988915] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.989298] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.989481] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.989681] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5a45a455-673b-417d-b2f6-be9352c2077e is going to be updated. [ 951.067027] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.067027] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.067027] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.067027] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.067027] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.067694] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fb3494b9-4ce5-4744-a378-ecbcd5c2bec9',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.087785] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5a45a455-673b-417d-b2f6-be9352c2077e in Status: IN_PROGRESS for 2s [ 951.276310] env[69232]: INFO networking_nsxv3.common.synchronization [req-323e9993-f23a-45b3-acd7-3710da1f1824 req-ea31432b-07b7-4f81-b4cf-8765cf966821 tempest-ServerRescueTestJSON-1367609634 tempest-ServerRescueTestJSON-1367609634-project-member] Enqueued Resource ID: 15a3e0ef-3467-49d4-a8b2-072fce21b190 with Priority: HIGHEST for action security_group_members [ 951.277137] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15a3e0ef-3467-49d4-a8b2-072fce21b190 with Priority: HIGHEST for action security_group_members [ 951.281527] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-15a3e0ef-3467-49d4-a8b2-072fce21b190 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.281701] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15a3e0ef-3467-49d4-a8b2-072fce21b190" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.281801] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15a3e0ef-3467-49d4-a8b2-072fce21b190" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.282134] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15a3e0ef-3467-49d4-a8b2-072fce21b190" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.282815] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.282815] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.282815] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.282815] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.282815] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.282815] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('15a3e0ef-3467-49d4-a8b2-072fce21b190',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.307527] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2d79fcdc-6c74-408a-b3fe-b8980eeb1219 [ 951.307896] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.307896] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.308168] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.308168] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.308329] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.308329] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2d79fcdc-6c74-408a-b3fe-b8980eeb1219 already deleted. [ 951.308629] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2d79fcdc-6c74-408a-b3fe-b8980eeb1219" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.462934] env[69232]: INFO networking_nsxv3.common.synchronization [req-f80c7120-5d1f-4279-855e-0e13786bb2ba req-ea139434-7525-42b3-9072-3631cda76e8a tempest-ServerActionsTestOtherB-650813181 tempest-ServerActionsTestOtherB-650813181-project-member] Enqueued Resource ID: 934b2684-b99c-4846-87df-66cbae10f2fc with Priority: HIGHEST for action security_group_members [ 951.462934] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 934b2684-b99c-4846-87df-66cbae10f2fc with Priority: HIGHEST for action security_group_members [ 951.463153] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-934b2684-b99c-4846-87df-66cbae10f2fc taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.463271] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-934b2684-b99c-4846-87df-66cbae10f2fc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.463318] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-934b2684-b99c-4846-87df-66cbae10f2fc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.463570] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-934b2684-b99c-4846-87df-66cbae10f2fc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.463729] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.463845] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.463892] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.464260] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.464260] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.464260] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('934b2684-b99c-4846-87df-66cbae10f2fc',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.578688] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.578688] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.578688] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.578688] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.578688] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.578688] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb3494b9-4ce5-4744-a378-ecbcd5c2bec9 is going to be updated. [ 951.611208] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.611338] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.611589] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.611589] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.612485] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.623451] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb3494b9-4ce5-4744-a378-ecbcd5c2bec9 in Status: IN_PROGRESS for 2s [ 951.785403] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('15a3e0ef-3467-49d4-a8b2-072fce21b190',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.967751] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.968100] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.969286] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.969933] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.970168] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.972623] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.972623] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.972623] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.972623] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.972623] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.972623] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 934b2684-b99c-4846-87df-66cbae10f2fc already deleted. [ 951.972623] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-934b2684-b99c-4846-87df-66cbae10f2fc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.115680] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock network-424 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.115877] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "network-424" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.116010] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "network-424" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.119022] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "network-424" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.119022] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.119022] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.119022] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.119022] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.119022] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.119022] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 952.119022] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] NeedRegenerationException {{(pid=69232) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 952.119022] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] no value, waiting for create lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 952.119022] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] value creation lock acquired {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 952.119022] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 952.119022] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Calling creation function for not-yet-present value {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 952.119022] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 952.144704] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 952.144704] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=69232) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 952.144704] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Released creation lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 952.145025] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "network-424" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.145142] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock port-a7a9e6d4-fed9-4e77-88c7-76aa1bf38ed1 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.145344] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "port-a7a9e6d4-fed9-4e77-88c7-76aa1bf38ed1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.145501] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "port-a7a9e6d4-fed9-4e77-88c7-76aa1bf38ed1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.145855] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "port-a7a9e6d4-fed9-4e77-88c7-76aa1bf38ed1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.146037] env[69232]: DEBUG networking_nsxv3.api.rpc [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a7a9e6d4-fed9-4e77-88c7-76aa1bf38ed1',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.289704] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('15a3e0ef-3467-49d4-a8b2-072fce21b190',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.650263] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.650506] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.650634] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.651017] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.651551] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.651551] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Segment Port a7a9e6d4-fed9-4e77-88c7-76aa1bf38ed1 not found, creating... [ 952.651878] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.651878] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.652038] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.652594] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.652770] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.653114] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.653281] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.653402] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.653645] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.653784] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.653955] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Resource: SegmentPort with ID: a7a9e6d4-fed9-4e77-88c7-76aa1bf38ed1 is going to be created. [ 952.678339] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.678570] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.678822] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.681024] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.681024] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.681024] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "port-a7a9e6d4-fed9-4e77-88c7-76aa1bf38ed1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.801923] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.802331] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.802331] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.802426] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.802524] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.802620] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15a3e0ef-3467-49d4-a8b2-072fce21b190 is going to be updated. [ 952.876250] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.876581] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.876581] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.876754] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.876829] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.890347] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15a3e0ef-3467-49d4-a8b2-072fce21b190 in Status: IN_PROGRESS for 2s [ 952.911540] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d2391c01-2410-4874-a5a8-6da2d957e88c in Status: SUCCESS [ 952.912202] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2391c01-2410-4874-a5a8-6da2d957e88c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.109550] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5a45a455-673b-417d-b2f6-be9352c2077e in Status: SUCCESS [ 953.109990] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5a45a455-673b-417d-b2f6-be9352c2077e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.396618] env[69232]: INFO networking_nsxv3.common.synchronization [req-f80c7120-5d1f-4279-855e-0e13786bb2ba req-33cbffbe-6d12-4e64-a2c9-e064ffe96bcd service nova] Enqueued Resource ID: 934b2684-b99c-4846-87df-66cbae10f2fc with Priority: HIGHEST for action security_group_rules [ 953.396822] env[69232]: INFO networking_nsxv3.common.synchronization [req-f80c7120-5d1f-4279-855e-0e13786bb2ba req-33cbffbe-6d12-4e64-a2c9-e064ffe96bcd service nova] Enqueued Resource ID: 934b2684-b99c-4846-87df-66cbae10f2fc with Priority: HIGHEST for action security_group_members [ 953.396996] env[69232]: INFO networking_nsxv3.common.synchronization [req-f80c7120-5d1f-4279-855e-0e13786bb2ba req-33cbffbe-6d12-4e64-a2c9-e064ffe96bcd service nova] Enqueued Resource ID: a7a9e6d4-fed9-4e77-88c7-76aa1bf38ed1 with Priority: HIGHEST for action port [ 953.397662] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 934b2684-b99c-4846-87df-66cbae10f2fc with Priority: HIGHEST for action security_group_rules [ 953.397789] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 934b2684-b99c-4846-87df-66cbae10f2fc with Priority: HIGHEST for action security_group_members [ 953.397900] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7a9e6d4-fed9-4e77-88c7-76aa1bf38ed1 with Priority: HIGHEST for action port [ 953.401602] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-934b2684-b99c-4846-87df-66cbae10f2fc taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.401602] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-934b2684-b99c-4846-87df-66cbae10f2fc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.401747] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-934b2684-b99c-4846-87df-66cbae10f2fc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.401981] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-934b2684-b99c-4846-87df-66cbae10f2fc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.402181] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('934b2684-b99c-4846-87df-66cbae10f2fc',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.403316] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-934b2684-b99c-4846-87df-66cbae10f2fc taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.403316] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-934b2684-b99c-4846-87df-66cbae10f2fc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.403407] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-934b2684-b99c-4846-87df-66cbae10f2fc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.407030] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-934b2684-b99c-4846-87df-66cbae10f2fc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.407030] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.407030] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.407030] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.407030] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.407030] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.407030] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('934b2684-b99c-4846-87df-66cbae10f2fc',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.407578] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-a7a9e6d4-fed9-4e77-88c7-76aa1bf38ed1 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.407578] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a7a9e6d4-fed9-4e77-88c7-76aa1bf38ed1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.407578] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a7a9e6d4-fed9-4e77-88c7-76aa1bf38ed1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.407940] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a7a9e6d4-fed9-4e77-88c7-76aa1bf38ed1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.407940] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a7a9e6d4-fed9-4e77-88c7-76aa1bf38ed1',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.635172] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb3494b9-4ce5-4744-a378-ecbcd5c2bec9 in Status: SUCCESS [ 953.635433] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.635926] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.636289] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.636597] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.636801] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.636921] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.637214] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.637356] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.637519] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.637682] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fb3494b9-4ce5-4744-a378-ecbcd5c2bec9',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.909129] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('934b2684-b99c-4846-87df-66cbae10f2fc',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.913963] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-934b2684-b99c-4846-87df-66cbae10f2fc taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.914168] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-934b2684-b99c-4846-87df-66cbae10f2fc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.914363] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a7a9e6d4-fed9-4e77-88c7-76aa1bf38ed1 with status ACTIVE [ 953.914459] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.914565] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.914630] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.914858] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.914946] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.915136] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.915233] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.915296] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.915454] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.915531] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.915711] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.915808] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.915871] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.916039] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.916118] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.916225] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a7a9e6d4-fed9-4e77-88c7-76aa1bf38ed1 is going to be updated. [ 953.946616] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.946616] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.946616] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.946808] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.946921] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.947118] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a7a9e6d4-fed9-4e77-88c7-76aa1bf38ed1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.144026] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.144420] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.144420] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.144558] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.144947] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.144947] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.144947] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.145161] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.146040] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.146040] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.146040] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.146040] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.146040] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.146040] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.146040] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.146387] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.146387] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.146554] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.146661] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.146774] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.146967] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fb3494b9-4ce5-4744-a378-ecbcd5c2bec9',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.252455] env[69232]: INFO networking_nsxv3.common.synchronization [req-6a9ecbf1-0770-4106-af96-b067fcbcbdcc req-92e6a618-4d1f-4ce4-889f-db8b60942ea2 tempest-ImagesOneServerNegativeTestJSON-501782696 tempest-ImagesOneServerNegativeTestJSON-501782696-project-member] Enqueued Resource ID: 6e7bf0fa-24cf-40f7-ac38-1adabda5207c with Priority: HIGHEST for action security_group_members [ 954.252455] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e7bf0fa-24cf-40f7-ac38-1adabda5207c with Priority: HIGHEST for action security_group_members [ 954.252797] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e7bf0fa-24cf-40f7-ac38-1adabda5207c taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.252969] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e7bf0fa-24cf-40f7-ac38-1adabda5207c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.253058] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e7bf0fa-24cf-40f7-ac38-1adabda5207c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.253266] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e7bf0fa-24cf-40f7-ac38-1adabda5207c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.253440] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.253560] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.253637] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.253794] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.253876] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.253971] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6e7bf0fa-24cf-40f7-ac38-1adabda5207c',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.414472] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('934b2684-b99c-4846-87df-66cbae10f2fc',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.643319] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock network-821 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.643573] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "network-821" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.643758] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "network-821" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.644124] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "network-821" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.644468] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.644678] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.644806] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.645076] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.645296] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.645547] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 954.645675] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] NeedRegenerationException {{(pid=69232) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 954.645832] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] no value, waiting for create lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 954.645989] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] value creation lock acquired {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 954.646139] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 954.646268] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Calling creation function for not-yet-present value {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 954.646450] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 954.649633] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fb3494b9-4ce5-4744-a378-ecbcd5c2bec9: rpc.has_security_group_logging(os_id): False [ 954.669217] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 954.669388] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69232) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 954.669641] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Released creation lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 954.669709] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "network-821" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.670179] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock port-23fc33a8-3a5e-4c6d-900d-858b706256bd taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.670390] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "port-23fc33a8-3a5e-4c6d-900d-858b706256bd" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.670495] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "port-23fc33a8-3a5e-4c6d-900d-858b706256bd" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.670901] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "port-23fc33a8-3a5e-4c6d-900d-858b706256bd" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.671082] env[69232]: DEBUG networking_nsxv3.api.rpc [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('23fc33a8-3a5e-4c6d-900d-858b706256bd',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.676069] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.676069] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.676069] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.676069] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.676069] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.676069] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.676069] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.676069] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.676069] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.676069] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.676069] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.676069] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.676069] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.676069] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.676069] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.676909] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.676909] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.676909] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.676909] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.676909] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.676909] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fb3494b9-4ce5-4744-a378-ecbcd5c2bec9 is going to be updated. [ 954.755462] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.755809] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.755809] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.756008] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.756217] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.759793] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.759921] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.759981] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.760221] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.760281] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.760500] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.760622] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.760700] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.760823] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.760901] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.760985] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e7bf0fa-24cf-40f7-ac38-1adabda5207c is going to be updated. [ 954.778135] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fb3494b9-4ce5-4744-a378-ecbcd5c2bec9 in Status: IN_PROGRESS for 2s [ 954.796670] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.796810] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.796881] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.800903] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.803882] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.813308] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e7bf0fa-24cf-40f7-ac38-1adabda5207c in Status: IN_PROGRESS for 2s [ 954.911611] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15a3e0ef-3467-49d4-a8b2-072fce21b190 in Status: SUCCESS [ 954.911611] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15a3e0ef-3467-49d4-a8b2-072fce21b190" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.917796] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.918369] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.918369] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.918515] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.918579] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.918726] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 934b2684-b99c-4846-87df-66cbae10f2fc is going to be created. [ 954.959600] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.959862] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.959862] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.960058] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.960216] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.971750] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 934b2684-b99c-4846-87df-66cbae10f2fc in Status: UNINITIALIZED for 2s [ 955.173555] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.173955] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.173955] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.174238] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.174334] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.174497] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Segment Port 23fc33a8-3a5e-4c6d-900d-858b706256bd not found, creating... [ 955.174844] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.174967] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.175083] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.175557] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.175651] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.176057] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.176161] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.176548] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.176548] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.176617] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.176755] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Resource: SegmentPort with ID: 23fc33a8-3a5e-4c6d-900d-858b706256bd is going to be created. [ 955.208742] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.209014] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.209188] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.209486] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.209894] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.210195] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "port-23fc33a8-3a5e-4c6d-900d-858b706256bd" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.923665] env[69232]: INFO networking_nsxv3.common.synchronization [req-6a9ecbf1-0770-4106-af96-b067fcbcbdcc req-b57438f9-a85c-4316-b427-8c6f226357cc service nova] Enqueued Resource ID: 6e7bf0fa-24cf-40f7-ac38-1adabda5207c with Priority: HIGHEST for action security_group_rules [ 955.923665] env[69232]: INFO networking_nsxv3.common.synchronization [req-6a9ecbf1-0770-4106-af96-b067fcbcbdcc req-b57438f9-a85c-4316-b427-8c6f226357cc service nova] Enqueued Resource ID: 6e7bf0fa-24cf-40f7-ac38-1adabda5207c with Priority: HIGHEST for action security_group_members [ 955.923665] env[69232]: INFO networking_nsxv3.common.synchronization [req-6a9ecbf1-0770-4106-af96-b067fcbcbdcc req-b57438f9-a85c-4316-b427-8c6f226357cc service nova] Enqueued Resource ID: 23fc33a8-3a5e-4c6d-900d-858b706256bd with Priority: HIGHEST for action port [ 955.924159] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e7bf0fa-24cf-40f7-ac38-1adabda5207c with Priority: HIGHEST for action security_group_rules [ 955.924369] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e7bf0fa-24cf-40f7-ac38-1adabda5207c with Priority: HIGHEST for action security_group_members [ 955.924474] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23fc33a8-3a5e-4c6d-900d-858b706256bd with Priority: HIGHEST for action port [ 955.925382] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6e7bf0fa-24cf-40f7-ac38-1adabda5207c taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.925485] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6e7bf0fa-24cf-40f7-ac38-1adabda5207c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.925602] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6e7bf0fa-24cf-40f7-ac38-1adabda5207c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.925856] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6e7bf0fa-24cf-40f7-ac38-1adabda5207c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.925955] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6e7bf0fa-24cf-40f7-ac38-1adabda5207c',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.926979] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e7bf0fa-24cf-40f7-ac38-1adabda5207c taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.927107] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e7bf0fa-24cf-40f7-ac38-1adabda5207c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.927384] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-23fc33a8-3a5e-4c6d-900d-858b706256bd taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.927483] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-23fc33a8-3a5e-4c6d-900d-858b706256bd" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.927483] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-23fc33a8-3a5e-4c6d-900d-858b706256bd" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.927646] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-23fc33a8-3a5e-4c6d-900d-858b706256bd" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.927721] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('23fc33a8-3a5e-4c6d-900d-858b706256bd',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.432234] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e7bf0fa-24cf-40f7-ac38-1adabda5207c taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.432678] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e7bf0fa-24cf-40f7-ac38-1adabda5207c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.432678] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 23fc33a8-3a5e-4c6d-900d-858b706256bd with status ACTIVE [ 956.432941] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.433200] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.433200] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.433454] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.433560] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.433767] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.433885] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.433951] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.434257] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.434403] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.438107] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.438107] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.438107] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.438107] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.438107] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.438107] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 23fc33a8-3a5e-4c6d-900d-858b706256bd is going to be updated. [ 956.465685] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.465827] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.465896] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.466135] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.466267] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.466428] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-23fc33a8-3a5e-4c6d-900d-858b706256bd" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.797888] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fb3494b9-4ce5-4744-a378-ecbcd5c2bec9 in Status: SUCCESS [ 956.798068] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.825778] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e7bf0fa-24cf-40f7-ac38-1adabda5207c in Status: SUCCESS [ 956.825975] env[69232]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e7bf0fa-24cf-40f7-ac38-1adabda5207c deletion is rescheduled due to dependency. [ 956.826118] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e7bf0fa-24cf-40f7-ac38-1adabda5207c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.826302] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e7bf0fa-24cf-40f7-ac38-1adabda5207c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.826704] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e7bf0fa-24cf-40f7-ac38-1adabda5207c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.826810] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.826909] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.826961] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.827129] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.827326] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.827326] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6e7bf0fa-24cf-40f7-ac38-1adabda5207c',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.986451] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 934b2684-b99c-4846-87df-66cbae10f2fc in Status: SUCCESS [ 956.986451] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-934b2684-b99c-4846-87df-66cbae10f2fc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.986451] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-934b2684-b99c-4846-87df-66cbae10f2fc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.986451] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-934b2684-b99c-4846-87df-66cbae10f2fc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.986451] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.986451] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.986451] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.986451] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.986451] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.986451] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-934b2684-b99c-4846-87df-66cbae10f2fc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.986451] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('934b2684-b99c-4846-87df-66cbae10f2fc',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.329560] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6e7bf0fa-24cf-40f7-ac38-1adabda5207c',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.489484] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('934b2684-b99c-4846-87df-66cbae10f2fc',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.835292] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6e7bf0fa-24cf-40f7-ac38-1adabda5207c',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.993055] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 934b2684-b99c-4846-87df-66cbae10f2fc: rpc.has_security_group_logging(os_id): False [ 958.014350] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.014592] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.014592] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.014758] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.014847] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.015205] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.015313] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.015415] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.015564] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.015661] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.015709] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 934b2684-b99c-4846-87df-66cbae10f2fc is going to be created. [ 958.087928] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.088701] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.088701] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.088701] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.088701] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.103357] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 934b2684-b99c-4846-87df-66cbae10f2fc in Status: IN_PROGRESS for 2s [ 958.249984] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock network-548 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.250321] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "network-548" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.250447] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "network-548" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.250683] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "network-548" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.250964] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.251340] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.251472] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.251710] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.251964] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.252206] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 958.252326] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] NeedRegenerationException {{(pid=69232) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 958.252440] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] no value, waiting for create lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 958.252552] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] value creation lock acquired {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 958.252664] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 958.252795] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Calling creation function for not-yet-present value {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 958.252989] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 958.298656] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 958.298656] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Cache value generated in 0.046 seconds for key(s): 'zone-id' {{(pid=69232) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 958.298787] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Released creation lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 958.298975] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "network-548" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.299375] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock port-ae4c1fa9-c369-45dc-8281-0eb74346b044 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.299504] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "port-ae4c1fa9-c369-45dc-8281-0eb74346b044" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.299632] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "port-ae4c1fa9-c369-45dc-8281-0eb74346b044" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.299997] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "port-ae4c1fa9-c369-45dc-8281-0eb74346b044" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.300168] env[69232]: DEBUG networking_nsxv3.api.rpc [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ae4c1fa9-c369-45dc-8281-0eb74346b044',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.338440] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.338440] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.338736] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.338891] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.338968] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.339212] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e7bf0fa-24cf-40f7-ac38-1adabda5207c is going to be updated. [ 958.384754] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.384939] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.384997] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.385208] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.385783] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.403237] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e7bf0fa-24cf-40f7-ac38-1adabda5207c in Status: IN_PROGRESS for 2s [ 958.803415] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.803820] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.803820] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.804112] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.804248] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.804618] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.804828] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.804968] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.805227] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.805378] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.805736] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.805850] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.805977] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.806205] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.806358] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.806526] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Resource: SegmentPort with ID: ae4c1fa9-c369-45dc-8281-0eb74346b044 is going to be updated. [ 958.855791] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.856119] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.856189] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.856464] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.856667] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.856910] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "port-ae4c1fa9-c369-45dc-8281-0eb74346b044" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.994641] env[69232]: INFO networking_nsxv3.common.synchronization [req-bb5bd359-fa87-46ce-bded-cb1dca4a7e4b req-07a82163-c307-460f-9d57-55a6751abc20 tempest-ListServerFiltersTestJSON-193943041 tempest-ListServerFiltersTestJSON-193943041-project-member] Enqueued Resource ID: 8f8cfd9d-acc3-4fa8-825d-c583365a30ed with Priority: HIGHEST for action security_group_members [ 958.995253] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f8cfd9d-acc3-4fa8-825d-c583365a30ed with Priority: HIGHEST for action security_group_members [ 958.995557] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f8cfd9d-acc3-4fa8-825d-c583365a30ed taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.995682] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f8cfd9d-acc3-4fa8-825d-c583365a30ed" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.995802] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f8cfd9d-acc3-4fa8-825d-c583365a30ed" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.995948] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f8cfd9d-acc3-4fa8-825d-c583365a30ed" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.996109] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.996202] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.996259] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.996454] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.996539] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.996634] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8f8cfd9d-acc3-4fa8-825d-c583365a30ed',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.499887] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8f8cfd9d-acc3-4fa8-825d-c583365a30ed',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.713753] env[69232]: INFO networking_nsxv3.common.synchronization [req-cbb751e6-83b2-4ecf-9bcc-90bbece8e69e req-bb75d224-6afb-47e6-abf3-fc29e2503f23 service nova] Enqueued Resource ID: 9ea0b8f1-7dc8-48fd-bd49-a3ae8c7a9645 with Priority: HIGHEST for action security_group_rules [ 959.714019] env[69232]: INFO networking_nsxv3.common.synchronization [req-cbb751e6-83b2-4ecf-9bcc-90bbece8e69e req-bb75d224-6afb-47e6-abf3-fc29e2503f23 service nova] Enqueued Resource ID: 9ea0b8f1-7dc8-48fd-bd49-a3ae8c7a9645 with Priority: HIGHEST for action security_group_members [ 959.714614] env[69232]: INFO networking_nsxv3.common.synchronization [req-cbb751e6-83b2-4ecf-9bcc-90bbece8e69e req-bb75d224-6afb-47e6-abf3-fc29e2503f23 service nova] Enqueued Resource ID: ae4c1fa9-c369-45dc-8281-0eb74346b044 with Priority: HIGHEST for action port [ 959.715188] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ea0b8f1-7dc8-48fd-bd49-a3ae8c7a9645 with Priority: HIGHEST for action security_group_rules [ 959.715188] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ea0b8f1-7dc8-48fd-bd49-a3ae8c7a9645 with Priority: HIGHEST for action security_group_members [ 959.715399] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae4c1fa9-c369-45dc-8281-0eb74346b044 with Priority: HIGHEST for action port [ 959.716550] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9ea0b8f1-7dc8-48fd-bd49-a3ae8c7a9645 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.716550] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9ea0b8f1-7dc8-48fd-bd49-a3ae8c7a9645" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.716550] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9ea0b8f1-7dc8-48fd-bd49-a3ae8c7a9645" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.716777] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9ea0b8f1-7dc8-48fd-bd49-a3ae8c7a9645" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.716838] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9ea0b8f1-7dc8-48fd-bd49-a3ae8c7a9645',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.717811] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ea0b8f1-7dc8-48fd-bd49-a3ae8c7a9645 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.717930] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ea0b8f1-7dc8-48fd-bd49-a3ae8c7a9645" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.717981] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ea0b8f1-7dc8-48fd-bd49-a3ae8c7a9645" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.719085] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ea0b8f1-7dc8-48fd-bd49-a3ae8c7a9645" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.719326] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.719393] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.719459] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.719657] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.719804] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.719849] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9ea0b8f1-7dc8-48fd-bd49-a3ae8c7a9645',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.722088] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-ae4c1fa9-c369-45dc-8281-0eb74346b044 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.722088] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ae4c1fa9-c369-45dc-8281-0eb74346b044" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.722088] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ae4c1fa9-c369-45dc-8281-0eb74346b044" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.722088] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ae4c1fa9-c369-45dc-8281-0eb74346b044" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.722088] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ae4c1fa9-c369-45dc-8281-0eb74346b044',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.003052] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8f8cfd9d-acc3-4fa8-825d-c583365a30ed',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.120215] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 934b2684-b99c-4846-87df-66cbae10f2fc in Status: IN_PROGRESS for 4s [ 960.223350] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ea0b8f1-7dc8-48fd-bd49-a3ae8c7a9645 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.223579] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ea0b8f1-7dc8-48fd-bd49-a3ae8c7a9645" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.223725] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9ea0b8f1-7dc8-48fd-bd49-a3ae8c7a9645',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.225665] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ae4c1fa9-c369-45dc-8281-0eb74346b044 with status ACTIVE [ 960.225879] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.226074] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.226212] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.226490] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.226587] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.226774] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.226879] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.226954] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.227306] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.227379] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.230211] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.230211] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.230211] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.230211] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.230211] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.230211] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ae4c1fa9-c369-45dc-8281-0eb74346b044 is going to be updated. [ 960.254743] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.254982] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.254982] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.255201] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.255347] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.255511] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ae4c1fa9-c369-45dc-8281-0eb74346b044" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.418154] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e7bf0fa-24cf-40f7-ac38-1adabda5207c in Status: SUCCESS [ 960.418403] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e7bf0fa-24cf-40f7-ac38-1adabda5207c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.418580] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e7bf0fa-24cf-40f7-ac38-1adabda5207c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.418836] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e7bf0fa-24cf-40f7-ac38-1adabda5207c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.419047] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.419209] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.419279] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.419475] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.419563] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.419707] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e7bf0fa-24cf-40f7-ac38-1adabda5207c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.419809] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6e7bf0fa-24cf-40f7-ac38-1adabda5207c',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.505391] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.505591] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.505710] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.505995] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.506200] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.506342] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8f8cfd9d-acc3-4fa8-825d-c583365a30ed is going to be updated. [ 960.530978] env[69232]: INFO networking_nsxv3.common.synchronization [req-230b329c-a1f1-460d-b81d-54e05e7578dc req-d6ff346c-2cd6-423e-8922-f10b768e3cc7 tempest-AttachInterfacesTestJSON-1442903876 tempest-AttachInterfacesTestJSON-1442903876-project-member] Enqueued Resource ID: 20ba03af-aba0-4fe6-af1e-ea103067fcbe with Priority: HIGHEST for action security_group_members [ 960.531806] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20ba03af-aba0-4fe6-af1e-ea103067fcbe with Priority: HIGHEST for action security_group_members [ 960.532254] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-20ba03af-aba0-4fe6-af1e-ea103067fcbe taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.532442] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-20ba03af-aba0-4fe6-af1e-ea103067fcbe" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.532495] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-20ba03af-aba0-4fe6-af1e-ea103067fcbe" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.532839] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-20ba03af-aba0-4fe6-af1e-ea103067fcbe" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.533084] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.533207] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.533248] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.533453] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.533540] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.533670] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('20ba03af-aba0-4fe6-af1e-ea103067fcbe',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.568875] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.569069] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.569143] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.569342] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.569488] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.587237] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f8cfd9d-acc3-4fa8-825d-c583365a30ed in Status: IN_PROGRESS for 2s [ 960.727050] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9ea0b8f1-7dc8-48fd-bd49-a3ae8c7a9645',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.924149] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e7bf0fa-24cf-40f7-ac38-1adabda5207c taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.924149] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e7bf0fa-24cf-40f7-ac38-1adabda5207c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.924149] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e7bf0fa-24cf-40f7-ac38-1adabda5207c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.924149] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e7bf0fa-24cf-40f7-ac38-1adabda5207c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.924149] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.924149] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.924149] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.924149] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.924149] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.924149] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e7bf0fa-24cf-40f7-ac38-1adabda5207c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.924149] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e7bf0fa-24cf-40f7-ac38-1adabda5207c taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.925055] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e7bf0fa-24cf-40f7-ac38-1adabda5207c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.926023] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e7bf0fa-24cf-40f7-ac38-1adabda5207c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.926023] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e7bf0fa-24cf-40f7-ac38-1adabda5207c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.926023] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.926023] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.926023] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.927842] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.929960] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.929960] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e7bf0fa-24cf-40f7-ac38-1adabda5207c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.929960] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6e7bf0fa-24cf-40f7-ac38-1adabda5207c',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.042213] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.042213] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.042213] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.042213] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.070689] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.071320] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.071808] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.073017] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.073017] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.073017] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.073017] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 20ba03af-aba0-4fe6-af1e-ea103067fcbe is going to be updated. [ 961.113691] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.113691] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.113691] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.114511] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.115737] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.127511] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock network-756 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.127915] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "network-756" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.129597] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "network-756" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.129597] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "network-756" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.129597] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.130208] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.130349] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.132210] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.132210] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.132210] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 961.132210] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] NeedRegenerationException {{(pid=69232) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 961.132210] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] no value, waiting for create lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 961.132567] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] value creation lock acquired {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 961.132801] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 961.133064] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Calling creation function for not-yet-present value {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 961.133411] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 961.136293] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 20ba03af-aba0-4fe6-af1e-ea103067fcbe in Status: IN_PROGRESS for 2s [ 961.175023] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 961.175341] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Cache value generated in 0.042 seconds for key(s): 'zone-id' {{(pid=69232) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 961.175541] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Released creation lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 961.175743] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "network-756" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.176199] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock port-8afb9dd6-15a2-41f2-b82e-8620b232cd48 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.177101] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "port-8afb9dd6-15a2-41f2-b82e-8620b232cd48" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.177101] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "port-8afb9dd6-15a2-41f2-b82e-8620b232cd48" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.177101] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "port-8afb9dd6-15a2-41f2-b82e-8620b232cd48" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.177664] env[69232]: DEBUG networking_nsxv3.api.rpc [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8afb9dd6-15a2-41f2-b82e-8620b232cd48',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.231618] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.231961] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.232090] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.232333] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.232418] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.232532] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9ea0b8f1-7dc8-48fd-bd49-a3ae8c7a9645 is going to be updated. [ 961.296308] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.296530] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.299685] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.299685] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.299685] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.310564] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ea0b8f1-7dc8-48fd-bd49-a3ae8c7a9645 in Status: IN_PROGRESS for 2s [ 961.431707] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6e7bf0fa-24cf-40f7-ac38-1adabda5207c: rpc.has_security_group_logging(os_id): False [ 961.453890] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.454171] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.454265] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.454507] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.454694] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.454803] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.454951] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.455088] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.455216] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.455322] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.455588] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.459119] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.459119] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.459119] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.459119] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.459119] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.459119] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.459119] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.459119] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.459119] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.459119] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6e7bf0fa-24cf-40f7-ac38-1adabda5207c is going to be updated. [ 961.539387] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.539561] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.539561] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.539873] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.540086] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.560319] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6e7bf0fa-24cf-40f7-ac38-1adabda5207c in Status: IN_PROGRESS for 2s [ 961.683037] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.683037] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.683037] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.683037] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.683037] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.683037] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Segment Port 8afb9dd6-15a2-41f2-b82e-8620b232cd48 not found, creating... [ 961.683037] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.683037] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.683037] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.683037] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.683037] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.683666] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.683666] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.683666] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.683788] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.684015] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.684101] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Resource: SegmentPort with ID: 8afb9dd6-15a2-41f2-b82e-8620b232cd48 is going to be created. [ 961.714500] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.714770] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.714894] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.715265] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.715560] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.715830] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "port-8afb9dd6-15a2-41f2-b82e-8620b232cd48" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.151816] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 934b2684-b99c-4846-87df-66cbae10f2fc in Status: IN_PROGRESS for 6s [ 962.522902] env[69232]: INFO networking_nsxv3.common.synchronization [req-230b329c-a1f1-460d-b81d-54e05e7578dc req-2ae277d5-8879-4456-91a5-b7ca1e4650c7 service nova] Enqueued Resource ID: 20ba03af-aba0-4fe6-af1e-ea103067fcbe with Priority: HIGHEST for action security_group_rules [ 962.523145] env[69232]: INFO networking_nsxv3.common.synchronization [req-230b329c-a1f1-460d-b81d-54e05e7578dc req-2ae277d5-8879-4456-91a5-b7ca1e4650c7 service nova] Enqueued Resource ID: 20ba03af-aba0-4fe6-af1e-ea103067fcbe with Priority: HIGHEST for action security_group_members [ 962.523797] env[69232]: INFO networking_nsxv3.common.synchronization [req-230b329c-a1f1-460d-b81d-54e05e7578dc req-2ae277d5-8879-4456-91a5-b7ca1e4650c7 service nova] Enqueued Resource ID: 8afb9dd6-15a2-41f2-b82e-8620b232cd48 with Priority: HIGHEST for action port [ 962.523797] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20ba03af-aba0-4fe6-af1e-ea103067fcbe with Priority: HIGHEST for action security_group_rules [ 962.523797] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20ba03af-aba0-4fe6-af1e-ea103067fcbe with Priority: HIGHEST for action security_group_members [ 962.523797] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8afb9dd6-15a2-41f2-b82e-8620b232cd48 with Priority: HIGHEST for action port [ 962.524449] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-20ba03af-aba0-4fe6-af1e-ea103067fcbe taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.524575] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-20ba03af-aba0-4fe6-af1e-ea103067fcbe" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.524678] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-20ba03af-aba0-4fe6-af1e-ea103067fcbe" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.524909] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-20ba03af-aba0-4fe6-af1e-ea103067fcbe" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.525026] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('20ba03af-aba0-4fe6-af1e-ea103067fcbe',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.526661] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-20ba03af-aba0-4fe6-af1e-ea103067fcbe taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.526661] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-20ba03af-aba0-4fe6-af1e-ea103067fcbe" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.526661] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-8afb9dd6-15a2-41f2-b82e-8620b232cd48 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.526661] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8afb9dd6-15a2-41f2-b82e-8620b232cd48" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.526661] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8afb9dd6-15a2-41f2-b82e-8620b232cd48" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.526661] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8afb9dd6-15a2-41f2-b82e-8620b232cd48" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.526661] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8afb9dd6-15a2-41f2-b82e-8620b232cd48',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.596751] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f8cfd9d-acc3-4fa8-825d-c583365a30ed in Status: SUCCESS [ 962.597018] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f8cfd9d-acc3-4fa8-825d-c583365a30ed" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.028757] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-20ba03af-aba0-4fe6-af1e-ea103067fcbe taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.029160] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-20ba03af-aba0-4fe6-af1e-ea103067fcbe" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.030656] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8afb9dd6-15a2-41f2-b82e-8620b232cd48 with status ACTIVE [ 963.030963] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.031224] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.034363] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.034363] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.034363] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.034363] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.034363] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.034363] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.034363] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.034363] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.034363] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.034363] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.034363] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.034771] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.034936] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.035856] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8afb9dd6-15a2-41f2-b82e-8620b232cd48 is going to be updated. [ 963.058804] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.059045] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.059045] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.059228] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.059364] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.060013] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8afb9dd6-15a2-41f2-b82e-8620b232cd48" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.159981] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 20ba03af-aba0-4fe6-af1e-ea103067fcbe in Status: SUCCESS [ 963.160375] env[69232]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 20ba03af-aba0-4fe6-af1e-ea103067fcbe deletion is rescheduled due to dependency. [ 963.160375] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-20ba03af-aba0-4fe6-af1e-ea103067fcbe" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.160504] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-20ba03af-aba0-4fe6-af1e-ea103067fcbe" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.160681] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-20ba03af-aba0-4fe6-af1e-ea103067fcbe" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.160861] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.160982] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.161055] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.161217] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.161298] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.161395] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('20ba03af-aba0-4fe6-af1e-ea103067fcbe',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.320720] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ea0b8f1-7dc8-48fd-bd49-a3ae8c7a9645 in Status: SUCCESS [ 963.320954] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ea0b8f1-7dc8-48fd-bd49-a3ae8c7a9645" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.322078] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ea0b8f1-7dc8-48fd-bd49-a3ae8c7a9645" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.322078] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ea0b8f1-7dc8-48fd-bd49-a3ae8c7a9645" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.322078] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.322078] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.322078] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.322078] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.322078] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.322931] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ea0b8f1-7dc8-48fd-bd49-a3ae8c7a9645" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.322931] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9ea0b8f1-7dc8-48fd-bd49-a3ae8c7a9645',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.585580] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6e7bf0fa-24cf-40f7-ac38-1adabda5207c in Status: SUCCESS [ 963.585919] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6e7bf0fa-24cf-40f7-ac38-1adabda5207c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.663940] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('20ba03af-aba0-4fe6-af1e-ea103067fcbe',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.825094] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9ea0b8f1-7dc8-48fd-bd49-a3ae8c7a9645',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.154295] env[69232]: INFO networking_nsxv3.common.synchronization [req-9341c5fb-4d79-4ecb-8e07-33b82ef094d9 req-e191d2cf-a6c2-4bde-897d-9f28c3704fe1 tempest-DeleteServersTestJSON-830271628 tempest-DeleteServersTestJSON-830271628-project-member] Enqueued Resource ID: 9f5186e6-2d35-4ccf-a8b4-749a0a872128 with Priority: HIGHEST for action security_group_members [ 964.154814] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f5186e6-2d35-4ccf-a8b4-749a0a872128 with Priority: HIGHEST for action security_group_members [ 964.155434] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f5186e6-2d35-4ccf-a8b4-749a0a872128 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.155561] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.155608] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.155808] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.155990] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.156134] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.156134] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.156292] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.156374] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.156459] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9f5186e6-2d35-4ccf-a8b4-749a0a872128',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.166366] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('20ba03af-aba0-4fe6-af1e-ea103067fcbe',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.171195] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 934b2684-b99c-4846-87df-66cbae10f2fc in Status: IN_PROGRESS for 8s [ 964.327710] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9ea0b8f1-7dc8-48fd-bd49-a3ae8c7a9645: rpc.has_security_group_logging(os_id): False [ 964.351841] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.352174] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.352274] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.352510] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.380752] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.380752] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.380752] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.380752] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.380752] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.380752] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.380752] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9ea0b8f1-7dc8-48fd-bd49-a3ae8c7a9645 is going to be updated. [ 964.491021] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.491021] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.491021] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.491021] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.491021] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.505244] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9ea0b8f1-7dc8-48fd-bd49-a3ae8c7a9645 in Status: IN_PROGRESS for 2s [ 964.568987] env[69232]: INFO networking_nsxv3.common.synchronization [req-a4ced8e9-cca7-4e2e-8619-d58b73b4a230 req-f8c896c7-8f7d-45a6-9ae3-11d51f1dbada tempest-ServersWithSpecificFlavorTestJSON-338716906 tempest-ServersWithSpecificFlavorTestJSON-338716906-project-member] Enqueued Resource ID: 06438b8f-6cee-4263-9d4c-43067bbe0a4c with Priority: HIGHEST for action security_group_members [ 964.568987] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06438b8f-6cee-4263-9d4c-43067bbe0a4c with Priority: HIGHEST for action security_group_members [ 964.576028] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-06438b8f-6cee-4263-9d4c-43067bbe0a4c taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.576028] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06438b8f-6cee-4263-9d4c-43067bbe0a4c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.576028] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06438b8f-6cee-4263-9d4c-43067bbe0a4c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.576028] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06438b8f-6cee-4263-9d4c-43067bbe0a4c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.576028] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.576028] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.576028] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.576028] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.576028] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.576028] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06438b8f-6cee-4263-9d4c-43067bbe0a4c',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.660871] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.661956] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.662133] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.662374] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.662477] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.662901] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.662901] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.662901] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.663106] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.663194] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.663286] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9f5186e6-2d35-4ccf-a8b4-749a0a872128 is going to be updated. [ 964.669909] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.670083] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.670143] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.670390] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.670543] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.670784] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 20ba03af-aba0-4fe6-af1e-ea103067fcbe is going to be updated. [ 964.712257] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.712461] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.712565] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.713135] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.714454] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.717015] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.717184] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.717289] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.717555] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.717746] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.734114] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f5186e6-2d35-4ccf-a8b4-749a0a872128 in Status: IN_PROGRESS for 2s [ 964.735584] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 20ba03af-aba0-4fe6-af1e-ea103067fcbe in Status: IN_PROGRESS for 2s [ 964.968639] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock network-279 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.969071] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "network-279" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.969335] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "network-279" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.969759] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "network-279" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.970604] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.970604] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.970967] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.971128] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.971387] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.971737] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 964.971969] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] NeedRegenerationException {{(pid=69232) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 964.972200] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] no value, waiting for create lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 964.972411] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] value creation lock acquired {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 964.972841] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 964.972841] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Calling creation function for not-yet-present value {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 964.973040] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 964.993949] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 964.994178] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69232) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 964.994351] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Released creation lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 964.994545] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "network-279" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.994876] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock port-ca585637-3f03-4e2d-92c0-f4700f7922a5 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.995208] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "port-ca585637-3f03-4e2d-92c0-f4700f7922a5" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.995388] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "port-ca585637-3f03-4e2d-92c0-f4700f7922a5" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.995827] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "port-ca585637-3f03-4e2d-92c0-f4700f7922a5" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.996008] env[69232]: DEBUG networking_nsxv3.api.rpc [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ca585637-3f03-4e2d-92c0-f4700f7922a5',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.082129] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.082129] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.082129] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.082129] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.082303] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.083532] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.083532] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.083532] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.083532] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.083532] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.083532] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06438b8f-6cee-4263-9d4c-43067bbe0a4c is going to be updated. [ 965.123623] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.123822] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.123822] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.124117] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.124285] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.136489] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06438b8f-6cee-4263-9d4c-43067bbe0a4c in Status: IN_PROGRESS for 2s [ 965.499021] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.499021] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.499419] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.499419] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.499628] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.499696] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Segment Port ca585637-3f03-4e2d-92c0-f4700f7922a5 not found, creating... [ 965.500181] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.500181] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.500327] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.500565] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.500604] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.500907] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.501217] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.501356] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.501618] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.501803] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.502062] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Resource: SegmentPort with ID: ca585637-3f03-4e2d-92c0-f4700f7922a5 is going to be created. [ 965.531362] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.531612] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.531612] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.531942] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.532285] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.532463] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "port-ca585637-3f03-4e2d-92c0-f4700f7922a5" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.137711] env[69232]: INFO networking_nsxv3.common.synchronization [req-b7c8aa27-52a9-4582-8fad-630732a4b09a req-dcfc7b75-92c0-413f-a7af-40293170c0e5 tempest-ServersTestJSON-524901877 tempest-ServersTestJSON-524901877-project-member] Enqueued Resource ID: bdcc7a21-dd0d-4296-ac34-a880ea6123e7 with Priority: HIGHEST for action security_group_members [ 966.138266] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdcc7a21-dd0d-4296-ac34-a880ea6123e7 with Priority: HIGHEST for action security_group_members [ 966.138372] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.138484] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.138524] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.139302] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.139302] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.139302] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.139302] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.139302] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.139302] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.139302] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bdcc7a21-dd0d-4296-ac34-a880ea6123e7',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.189725] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 934b2684-b99c-4846-87df-66cbae10f2fc in Status: IN_PROGRESS for 10s [ 966.519794] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9ea0b8f1-7dc8-48fd-bd49-a3ae8c7a9645 in Status: SUCCESS [ 966.522986] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9ea0b8f1-7dc8-48fd-bd49-a3ae8c7a9645" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.596906] env[69232]: INFO networking_nsxv3.common.synchronization [req-9341c5fb-4d79-4ecb-8e07-33b82ef094d9 req-f78a3cd9-25fb-4d23-9192-85802010eba6 service nova] Enqueued Resource ID: 9f5186e6-2d35-4ccf-a8b4-749a0a872128 with Priority: HIGHEST for action security_group_rules [ 966.597093] env[69232]: INFO networking_nsxv3.common.synchronization [req-9341c5fb-4d79-4ecb-8e07-33b82ef094d9 req-f78a3cd9-25fb-4d23-9192-85802010eba6 service nova] Enqueued Resource ID: 9f5186e6-2d35-4ccf-a8b4-749a0a872128 with Priority: HIGHEST for action security_group_members [ 966.597248] env[69232]: INFO networking_nsxv3.common.synchronization [req-9341c5fb-4d79-4ecb-8e07-33b82ef094d9 req-f78a3cd9-25fb-4d23-9192-85802010eba6 service nova] Enqueued Resource ID: ca585637-3f03-4e2d-92c0-f4700f7922a5 with Priority: HIGHEST for action port [ 966.598010] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f5186e6-2d35-4ccf-a8b4-749a0a872128 with Priority: HIGHEST for action security_group_rules [ 966.598414] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f5186e6-2d35-4ccf-a8b4-749a0a872128 with Priority: HIGHEST for action security_group_members [ 966.598660] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca585637-3f03-4e2d-92c0-f4700f7922a5 with Priority: HIGHEST for action port [ 966.599070] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9f5186e6-2d35-4ccf-a8b4-749a0a872128 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.599243] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.599338] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.599879] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.599879] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9f5186e6-2d35-4ccf-a8b4-749a0a872128',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.604600] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f5186e6-2d35-4ccf-a8b4-749a0a872128 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.604725] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.605507] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-ca585637-3f03-4e2d-92c0-f4700f7922a5 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.605645] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ca585637-3f03-4e2d-92c0-f4700f7922a5" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.605717] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ca585637-3f03-4e2d-92c0-f4700f7922a5" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.606012] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ca585637-3f03-4e2d-92c0-f4700f7922a5" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.606964] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ca585637-3f03-4e2d-92c0-f4700f7922a5',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.641492] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bdcc7a21-dd0d-4296-ac34-a880ea6123e7',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.747834] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 20ba03af-aba0-4fe6-af1e-ea103067fcbe in Status: SUCCESS [ 966.748220] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-20ba03af-aba0-4fe6-af1e-ea103067fcbe" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.749052] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-20ba03af-aba0-4fe6-af1e-ea103067fcbe" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.749052] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-20ba03af-aba0-4fe6-af1e-ea103067fcbe" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.749515] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.749515] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.749515] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.749704] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.749704] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.749793] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-20ba03af-aba0-4fe6-af1e-ea103067fcbe" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.749929] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('20ba03af-aba0-4fe6-af1e-ea103067fcbe',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.753317] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f5186e6-2d35-4ccf-a8b4-749a0a872128 in Status: SUCCESS [ 966.753564] env[69232]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9f5186e6-2d35-4ccf-a8b4-749a0a872128 deletion is rescheduled due to dependency. [ 966.753734] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.753865] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.754447] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.754447] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.754580] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.754580] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.754779] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.754887] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.755031] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9f5186e6-2d35-4ccf-a8b4-749a0a872128',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.758026] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock network-738 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.758236] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "network-738" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.758414] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "network-738" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.759090] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "network-738" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.759374] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.759555] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.759751] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.760026] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.760195] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.760988] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 966.760988] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] NeedRegenerationException {{(pid=69232) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 966.761233] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] no value, waiting for create lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 966.761288] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] value creation lock acquired {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 966.761475] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 966.761660] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Calling creation function for not-yet-present value {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 966.761939] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 966.765590] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9f5186e6-2d35-4ccf-a8b4-749a0a872128',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.805105] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 966.805347] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Cache value generated in 0.043 seconds for key(s): 'zone-id' {{(pid=69232) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 966.805508] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Released creation lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 966.805723] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "network-738" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.806121] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock port-4f9220e7-045c-4608-97fb-3ce34f7d6975 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.806325] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "port-4f9220e7-045c-4608-97fb-3ce34f7d6975" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.806494] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "port-4f9220e7-045c-4608-97fb-3ce34f7d6975" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.806880] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "port-4f9220e7-045c-4608-97fb-3ce34f7d6975" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.807225] env[69232]: DEBUG networking_nsxv3.api.rpc [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4f9220e7-045c-4608-97fb-3ce34f7d6975',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.109051] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f5186e6-2d35-4ccf-a8b4-749a0a872128 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.109246] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.111647] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ca585637-3f03-4e2d-92c0-f4700f7922a5 with status ACTIVE [ 967.111934] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.112097] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.112155] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.112364] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.112757] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.112757] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.112757] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.112932] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.112932] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.113104] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.113205] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.113338] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.113395] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.113498] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.113568] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.113657] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ca585637-3f03-4e2d-92c0-f4700f7922a5 is going to be updated. [ 967.144964] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bdcc7a21-dd0d-4296-ac34-a880ea6123e7',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.155529] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06438b8f-6cee-4263-9d4c-43067bbe0a4c in Status: SUCCESS [ 967.155694] env[69232]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06438b8f-6cee-4263-9d4c-43067bbe0a4c deletion is rescheduled due to dependency. [ 967.155737] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06438b8f-6cee-4263-9d4c-43067bbe0a4c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.165217] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.165409] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.165507] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.165662] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.165910] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.165997] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ca585637-3f03-4e2d-92c0-f4700f7922a5" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.253190] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-20ba03af-aba0-4fe6-af1e-ea103067fcbe taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.253190] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-20ba03af-aba0-4fe6-af1e-ea103067fcbe" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.253190] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-20ba03af-aba0-4fe6-af1e-ea103067fcbe" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.253411] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-20ba03af-aba0-4fe6-af1e-ea103067fcbe" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.253624] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.253738] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.253779] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.253938] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.254083] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.254175] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-20ba03af-aba0-4fe6-af1e-ea103067fcbe" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.254345] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-20ba03af-aba0-4fe6-af1e-ea103067fcbe taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.254448] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-20ba03af-aba0-4fe6-af1e-ea103067fcbe" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.254505] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-20ba03af-aba0-4fe6-af1e-ea103067fcbe" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.254668] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-20ba03af-aba0-4fe6-af1e-ea103067fcbe" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.254813] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.255124] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.255248] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.255415] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.256043] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.256043] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-20ba03af-aba0-4fe6-af1e-ea103067fcbe" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.256043] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('20ba03af-aba0-4fe6-af1e-ea103067fcbe',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.268659] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9f5186e6-2d35-4ccf-a8b4-749a0a872128',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.310209] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.310534] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.310586] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.310960] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.311132] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.311346] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Segment Port 4f9220e7-045c-4608-97fb-3ce34f7d6975 not found, creating... [ 967.311851] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.312079] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.312248] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.312553] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.312737] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.313091] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.313313] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.313470] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.313736] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.313995] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.314090] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Resource: SegmentPort with ID: 4f9220e7-045c-4608-97fb-3ce34f7d6975 is going to be created. [ 967.347323] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.347571] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.347985] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.348266] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.348517] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.348768] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "port-4f9220e7-045c-4608-97fb-3ce34f7d6975" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.647251] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.647251] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.647550] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.647550] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.647608] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.647707] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bdcc7a21-dd0d-4296-ac34-a880ea6123e7 is going to be updated. [ 967.684707] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.684942] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.684942] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.685170] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.685295] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.694783] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bdcc7a21-dd0d-4296-ac34-a880ea6123e7 in Status: IN_PROGRESS for 2s [ 967.758319] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 20ba03af-aba0-4fe6-af1e-ea103067fcbe: rpc.has_security_group_logging(os_id): False [ 967.771560] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.771838] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.771958] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.772239] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.772382] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.772523] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9f5186e6-2d35-4ccf-a8b4-749a0a872128 is going to be updated. [ 967.782232] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.782379] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.782433] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.782655] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.782747] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.782982] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.783100] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.783165] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.783330] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.783410] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.783598] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.783693] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.783764] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.783885] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.783960] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.784152] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.784277] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.784309] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.784430] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.784499] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.784583] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 20ba03af-aba0-4fe6-af1e-ea103067fcbe is going to be updated. [ 967.841715] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.842575] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.842685] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.842920] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.843086] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.857446] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f5186e6-2d35-4ccf-a8b4-749a0a872128 in Status: IN_PROGRESS for 2s [ 967.887377] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.887377] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.887580] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.887642] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.887822] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.901139] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 20ba03af-aba0-4fe6-af1e-ea103067fcbe in Status: IN_PROGRESS for 2s [ 968.207455] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 934b2684-b99c-4846-87df-66cbae10f2fc in Status: IN_PROGRESS for 12s [ 968.545450] env[69232]: INFO networking_nsxv3.common.synchronization [req-b7c8aa27-52a9-4582-8fad-630732a4b09a req-7a343676-cce2-488d-904d-2f23dab590a9 service nova] Enqueued Resource ID: bdcc7a21-dd0d-4296-ac34-a880ea6123e7 with Priority: HIGHEST for action security_group_rules [ 968.545744] env[69232]: INFO networking_nsxv3.common.synchronization [req-b7c8aa27-52a9-4582-8fad-630732a4b09a req-7a343676-cce2-488d-904d-2f23dab590a9 service nova] Enqueued Resource ID: bdcc7a21-dd0d-4296-ac34-a880ea6123e7 with Priority: HIGHEST for action security_group_members [ 968.546041] env[69232]: INFO networking_nsxv3.common.synchronization [req-b7c8aa27-52a9-4582-8fad-630732a4b09a req-7a343676-cce2-488d-904d-2f23dab590a9 service nova] Enqueued Resource ID: 4f9220e7-045c-4608-97fb-3ce34f7d6975 with Priority: HIGHEST for action port [ 968.547049] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdcc7a21-dd0d-4296-ac34-a880ea6123e7 with Priority: HIGHEST for action security_group_rules [ 968.547757] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdcc7a21-dd0d-4296-ac34-a880ea6123e7 with Priority: HIGHEST for action security_group_members [ 968.547990] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f9220e7-045c-4608-97fb-3ce34f7d6975 with Priority: HIGHEST for action port [ 968.550319] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bdcc7a21-dd0d-4296-ac34-a880ea6123e7 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.550319] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.550319] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.550319] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.550319] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bdcc7a21-dd0d-4296-ac34-a880ea6123e7',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.550319] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.550319] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.550319] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-4f9220e7-045c-4608-97fb-3ce34f7d6975 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.550754] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4f9220e7-045c-4608-97fb-3ce34f7d6975" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.550754] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4f9220e7-045c-4608-97fb-3ce34f7d6975" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.550754] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4f9220e7-045c-4608-97fb-3ce34f7d6975" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.550754] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4f9220e7-045c-4608-97fb-3ce34f7d6975',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.578186] env[69232]: INFO networking_nsxv3.common.synchronization [None req-1a249525-b552-471c-ab44-d00e818364be tempest-AttachInterfacesTestJSON-1442903876 tempest-AttachInterfacesTestJSON-1442903876-project-member] Enqueued Resource ID: 20ba03af-aba0-4fe6-af1e-ea103067fcbe with Priority: HIGHEST for action security_group_members [ 968.578186] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20ba03af-aba0-4fe6-af1e-ea103067fcbe with Priority: HIGHEST for action security_group_members [ 968.578186] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-20ba03af-aba0-4fe6-af1e-ea103067fcbe taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.578186] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-20ba03af-aba0-4fe6-af1e-ea103067fcbe" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.578943] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-20ba03af-aba0-4fe6-af1e-ea103067fcbe" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.579365] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-20ba03af-aba0-4fe6-af1e-ea103067fcbe" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.579651] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.579920] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.580099] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.580631] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.580824] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.581028] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('20ba03af-aba0-4fe6-af1e-ea103067fcbe',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.899783] env[69232]: INFO networking_nsxv3.common.synchronization [req-d2902788-0756-4546-8075-76c8d5dfbd7f req-c4a9bf78-4ee1-4006-a40d-ae736d24a112 tempest-ImagesOneServerNegativeTestJSON-501782696 tempest-ImagesOneServerNegativeTestJSON-501782696-project-member] Enqueued Resource ID: 6e7bf0fa-24cf-40f7-ac38-1adabda5207c with Priority: HIGHEST for action security_group_members [ 968.900357] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e7bf0fa-24cf-40f7-ac38-1adabda5207c with Priority: HIGHEST for action security_group_members [ 968.900671] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e7bf0fa-24cf-40f7-ac38-1adabda5207c taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.900834] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e7bf0fa-24cf-40f7-ac38-1adabda5207c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.900959] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e7bf0fa-24cf-40f7-ac38-1adabda5207c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.901233] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e7bf0fa-24cf-40f7-ac38-1adabda5207c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.901452] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.901659] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.901709] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.902628] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.902628] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.902628] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6e7bf0fa-24cf-40f7-ac38-1adabda5207c',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.054427] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4f9220e7-045c-4608-97fb-3ce34f7d6975 with status ACTIVE [ 969.054707] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.054858] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.054927] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.058026] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.058026] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.058026] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.058026] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.058026] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.058026] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.058026] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.058026] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.058026] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.058026] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.058026] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.058026] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.058026] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4f9220e7-045c-4608-97fb-3ce34f7d6975 is going to be updated. [ 969.059618] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.059704] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.084983] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('20ba03af-aba0-4fe6-af1e-ea103067fcbe',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.114502] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.114502] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.114738] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.114853] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.114978] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.115192] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4f9220e7-045c-4608-97fb-3ce34f7d6975" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.408022] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.408153] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.408335] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.411021] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.411021] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.411021] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.411021] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.411021] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.411021] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.411021] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.411021] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e7bf0fa-24cf-40f7-ac38-1adabda5207c is going to be updated. [ 969.447032] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.447032] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.447032] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.447032] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.447032] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.460221] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e7bf0fa-24cf-40f7-ac38-1adabda5207c in Status: IN_PROGRESS for 2s [ 969.588941] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('20ba03af-aba0-4fe6-af1e-ea103067fcbe',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.708992] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bdcc7a21-dd0d-4296-ac34-a880ea6123e7 in Status: SUCCESS [ 969.709256] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.709433] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.709662] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.710099] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.710442] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.710546] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.710762] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.711766] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.711766] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bdcc7a21-dd0d-4296-ac34-a880ea6123e7',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.868818] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f5186e6-2d35-4ccf-a8b4-749a0a872128 in Status: SUCCESS [ 969.869104] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.869250] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.869480] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.869710] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.869882] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.869956] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.870139] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.870225] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.870313] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.870418] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9f5186e6-2d35-4ccf-a8b4-749a0a872128',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.928700] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 20ba03af-aba0-4fe6-af1e-ea103067fcbe in Status: SUCCESS [ 969.929079] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-20ba03af-aba0-4fe6-af1e-ea103067fcbe" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.094393] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.094501] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.094718] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.094840] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.095314] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.095314] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 20ba03af-aba0-4fe6-af1e-ea103067fcbe is going to be updated. [ 970.130519] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.130785] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.130785] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.131053] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.131179] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.137730] env[69232]: INFO networking_nsxv3.common.synchronization [req-ee6dc1aa-e20c-4165-bede-9370433f889b req-f69f1559-127b-4555-affe-77adda5193f4 tempest-ImagesTestJSON-1245210724 tempest-ImagesTestJSON-1245210724-project-member] Enqueued Resource ID: fb3494b9-4ce5-4744-a378-ecbcd5c2bec9 with Priority: HIGHEST for action security_group_members [ 970.138431] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb3494b9-4ce5-4744-a378-ecbcd5c2bec9 with Priority: HIGHEST for action security_group_members [ 970.138675] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.138817] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.138877] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.139095] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.139870] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.139870] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.139870] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.139870] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.139870] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.139870] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fb3494b9-4ce5-4744-a378-ecbcd5c2bec9',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.146633] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 20ba03af-aba0-4fe6-af1e-ea103067fcbe in Status: IN_PROGRESS for 2s [ 970.213331] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bdcc7a21-dd0d-4296-ac34-a880ea6123e7',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.220157] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 934b2684-b99c-4846-87df-66cbae10f2fc in Status: IN_PROGRESS for 14s [ 970.373343] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f5186e6-2d35-4ccf-a8b4-749a0a872128 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.373885] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.373885] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.373885] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.374219] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.374219] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.374219] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.374408] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.374515] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.374611] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.374780] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f5186e6-2d35-4ccf-a8b4-749a0a872128 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.374903] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.374984] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.375181] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.375346] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.375465] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.375537] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.375705] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.375796] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.375882] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.376013] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9f5186e6-2d35-4ccf-a8b4-749a0a872128',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.641823] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fb3494b9-4ce5-4744-a378-ecbcd5c2bec9',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.715872] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bdcc7a21-dd0d-4296-ac34-a880ea6123e7',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.879134] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9f5186e6-2d35-4ccf-a8b4-749a0a872128: rpc.has_security_group_logging(os_id): False [ 970.900230] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.900230] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.900230] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.900230] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.900230] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.900230] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.900230] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.900230] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.900789] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.900789] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.900789] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.900789] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.900789] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.901000] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.901000] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.903536] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.903536] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.903536] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.903536] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.903536] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.903536] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9f5186e6-2d35-4ccf-a8b4-749a0a872128 is going to be updated. [ 970.981342] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.981342] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.981342] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.981342] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.981342] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.994806] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9f5186e6-2d35-4ccf-a8b4-749a0a872128 in Status: IN_PROGRESS for 2s [ 971.145034] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fb3494b9-4ce5-4744-a378-ecbcd5c2bec9',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.220974] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.221259] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.221389] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.221741] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.221912] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.222154] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bdcc7a21-dd0d-4296-ac34-a880ea6123e7 is going to be updated. [ 971.266624] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.266759] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.266819] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.267127] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.267318] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.279601] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bdcc7a21-dd0d-4296-ac34-a880ea6123e7 in Status: IN_PROGRESS for 2s [ 971.475549] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e7bf0fa-24cf-40f7-ac38-1adabda5207c in Status: SUCCESS [ 971.475549] env[69232]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e7bf0fa-24cf-40f7-ac38-1adabda5207c deletion is rescheduled due to dependency. [ 971.475549] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e7bf0fa-24cf-40f7-ac38-1adabda5207c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.650040] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.650040] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.650040] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.650040] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.650040] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.650040] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb3494b9-4ce5-4744-a378-ecbcd5c2bec9 is going to be updated. [ 971.686301] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.686301] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.686301] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.686301] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.686301] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.702436] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb3494b9-4ce5-4744-a378-ecbcd5c2bec9 in Status: IN_PROGRESS for 2s [ 972.044725] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock network-756 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.045213] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "network-756" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.045213] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "network-756" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.045351] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "network-756" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.045715] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.046507] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.046690] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.047203] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.047203] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.047526] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 972.047679] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] NeedRegenerationException {{(pid=69232) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 972.047818] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] no value, waiting for create lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 972.047956] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] value creation lock acquired {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 972.048230] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 972.048267] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Calling creation function for not-yet-present value {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 972.048444] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 972.092630] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 972.092807] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Cache value generated in 0.044 seconds for key(s): 'zone-id' {{(pid=69232) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 972.093010] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Released creation lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 972.093212] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "network-756" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.093549] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock port-162fa375-18e9-4f6b-be3b-52e23e69ab94 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.093779] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "port-162fa375-18e9-4f6b-be3b-52e23e69ab94" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.093924] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "port-162fa375-18e9-4f6b-be3b-52e23e69ab94" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.094341] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "port-162fa375-18e9-4f6b-be3b-52e23e69ab94" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.094437] env[69232]: DEBUG networking_nsxv3.api.rpc [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('162fa375-18e9-4f6b-be3b-52e23e69ab94',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.166383] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 20ba03af-aba0-4fe6-af1e-ea103067fcbe in Status: SUCCESS [ 972.166857] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-20ba03af-aba0-4fe6-af1e-ea103067fcbe" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.239396] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 934b2684-b99c-4846-87df-66cbae10f2fc in Status: IN_PROGRESS for 16s [ 972.597216] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.597465] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.597759] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.597944] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.598142] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.598312] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Segment Port 162fa375-18e9-4f6b-be3b-52e23e69ab94 not found, creating... [ 972.598312] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.598807] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.598866] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.599140] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.599289] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.599599] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.599766] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.599908] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.601316] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.601473] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.601641] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Resource: SegmentPort with ID: 162fa375-18e9-4f6b-be3b-52e23e69ab94 is going to be created. [ 972.630731] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.630731] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.630974] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.631717] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.631927] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.632253] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "port-162fa375-18e9-4f6b-be3b-52e23e69ab94" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.011508] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9f5186e6-2d35-4ccf-a8b4-749a0a872128 in Status: SUCCESS [ 973.011741] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.293332] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bdcc7a21-dd0d-4296-ac34-a880ea6123e7 in Status: SUCCESS [ 973.293652] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.293737] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.293991] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.294439] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.294574] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.294574] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.295043] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.295043] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.295043] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.295043] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bdcc7a21-dd0d-4296-ac34-a880ea6123e7',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.411565] env[69232]: INFO networking_nsxv3.common.synchronization [req-761c61c6-aebd-44ea-9a7e-faab05cb73cd req-555ade03-1f0b-459b-98cc-4be9ee8134b7 service nova] Enqueued Resource ID: 20ba03af-aba0-4fe6-af1e-ea103067fcbe with Priority: HIGHEST for action security_group_rules [ 973.412014] env[69232]: INFO networking_nsxv3.common.synchronization [req-761c61c6-aebd-44ea-9a7e-faab05cb73cd req-555ade03-1f0b-459b-98cc-4be9ee8134b7 service nova] Enqueued Resource ID: 20ba03af-aba0-4fe6-af1e-ea103067fcbe with Priority: HIGHEST for action security_group_members [ 973.412014] env[69232]: INFO networking_nsxv3.common.synchronization [req-761c61c6-aebd-44ea-9a7e-faab05cb73cd req-555ade03-1f0b-459b-98cc-4be9ee8134b7 service nova] Enqueued Resource ID: 162fa375-18e9-4f6b-be3b-52e23e69ab94 with Priority: HIGHEST for action port [ 973.413490] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20ba03af-aba0-4fe6-af1e-ea103067fcbe with Priority: HIGHEST for action security_group_rules [ 973.416382] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20ba03af-aba0-4fe6-af1e-ea103067fcbe with Priority: HIGHEST for action security_group_members [ 973.417011] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 162fa375-18e9-4f6b-be3b-52e23e69ab94 with Priority: HIGHEST for action port [ 973.417011] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-20ba03af-aba0-4fe6-af1e-ea103067fcbe taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.417011] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-20ba03af-aba0-4fe6-af1e-ea103067fcbe" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.417164] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-20ba03af-aba0-4fe6-af1e-ea103067fcbe" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.417555] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-20ba03af-aba0-4fe6-af1e-ea103067fcbe" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.417849] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('20ba03af-aba0-4fe6-af1e-ea103067fcbe',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.421398] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-20ba03af-aba0-4fe6-af1e-ea103067fcbe taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.421534] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-20ba03af-aba0-4fe6-af1e-ea103067fcbe" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.421605] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-20ba03af-aba0-4fe6-af1e-ea103067fcbe" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.421862] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-20ba03af-aba0-4fe6-af1e-ea103067fcbe" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.422070] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.422174] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.422235] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.422396] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.422480] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.422573] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('20ba03af-aba0-4fe6-af1e-ea103067fcbe',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.423585] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-162fa375-18e9-4f6b-be3b-52e23e69ab94 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.423721] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-162fa375-18e9-4f6b-be3b-52e23e69ab94" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.423763] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-162fa375-18e9-4f6b-be3b-52e23e69ab94" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.423916] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-162fa375-18e9-4f6b-be3b-52e23e69ab94" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.423991] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('162fa375-18e9-4f6b-be3b-52e23e69ab94',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.713721] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb3494b9-4ce5-4744-a378-ecbcd5c2bec9 in Status: SUCCESS [ 973.713721] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.800877] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.800877] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.800877] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.800877] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.800877] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.800877] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.800877] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.800877] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.800877] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.800877] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.800877] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.800877] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.800877] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.800877] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.800877] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.800877] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.801451] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.801451] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.801451] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.801451] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.801451] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bdcc7a21-dd0d-4296-ac34-a880ea6123e7',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.921367] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-20ba03af-aba0-4fe6-af1e-ea103067fcbe taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.922020] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-20ba03af-aba0-4fe6-af1e-ea103067fcbe" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.930264] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('20ba03af-aba0-4fe6-af1e-ea103067fcbe',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.930264] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 162fa375-18e9-4f6b-be3b-52e23e69ab94 with status ACTIVE [ 973.930264] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.930264] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.930264] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.930264] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.930264] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.930264] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.930264] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.930264] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.930264] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.930264] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.930264] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.930264] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.930264] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.930264] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.933339] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.933339] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 162fa375-18e9-4f6b-be3b-52e23e69ab94 is going to be updated. [ 973.977793] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.977793] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.977793] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.977793] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.977793] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.977793] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-162fa375-18e9-4f6b-be3b-52e23e69ab94" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.258223] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 934b2684-b99c-4846-87df-66cbae10f2fc in Status: IN_PROGRESS for 18s [ 974.302881] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bdcc7a21-dd0d-4296-ac34-a880ea6123e7: rpc.has_security_group_logging(os_id): False [ 974.329711] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.329711] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.329711] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.329711] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.329711] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.329711] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.329711] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.329711] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.329711] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.329711] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.332178] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.332178] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.332178] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.332178] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.332178] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.332178] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.332178] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.332178] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.332178] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.332178] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.332178] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bdcc7a21-dd0d-4296-ac34-a880ea6123e7 is going to be updated. [ 974.420223] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.425333] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.425333] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.425333] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.425333] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.429096] env[69232]: INFO networking_nsxv3.common.synchronization [req-aecdbc84-2792-4b9b-8ed6-24d997e9c42c req-8fb0676a-1406-4620-9435-410055abc3a3 tempest-ServersNegativeTestJSON-459402880 tempest-ServersNegativeTestJSON-459402880-project-member] Enqueued Resource ID: 83d1cdee-a934-490e-9869-707c6882be9d with Priority: HIGHEST for action security_group_members [ 974.430119] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83d1cdee-a934-490e-9869-707c6882be9d with Priority: HIGHEST for action security_group_members [ 974.430269] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-83d1cdee-a934-490e-9869-707c6882be9d taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.430383] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-83d1cdee-a934-490e-9869-707c6882be9d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.430441] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-83d1cdee-a934-490e-9869-707c6882be9d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.431080] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-83d1cdee-a934-490e-9869-707c6882be9d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.431080] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.433589] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.433692] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.434638] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.434638] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.434638] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('83d1cdee-a934-490e-9869-707c6882be9d',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.435652] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('20ba03af-aba0-4fe6-af1e-ea103067fcbe',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.444845] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bdcc7a21-dd0d-4296-ac34-a880ea6123e7 in Status: IN_PROGRESS for 2s [ 974.628346] env[69232]: INFO networking_nsxv3.common.synchronization [None req-4cb24d3e-5aa2-4480-977d-c740d300df3c None None] Enqueued Resource ID: a30bbb52-64f6-450b-bd4d-26a201ad310c with Priority: HIGHEST for action port [ 974.628346] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a30bbb52-64f6-450b-bd4d-26a201ad310c with Priority: HIGHEST for action port [ 974.628346] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-a30bbb52-64f6-450b-bd4d-26a201ad310c taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.628346] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a30bbb52-64f6-450b-bd4d-26a201ad310c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.628346] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a30bbb52-64f6-450b-bd4d-26a201ad310c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.628346] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a30bbb52-64f6-450b-bd4d-26a201ad310c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.628346] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a30bbb52-64f6-450b-bd4d-26a201ad310c',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.938336] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.938789] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.938998] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.939673] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.941788] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.941788] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.941788] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.941788] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.941788] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.941788] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.941788] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 83d1cdee-a934-490e-9869-707c6882be9d already deleted. [ 974.941788] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-83d1cdee-a934-490e-9869-707c6882be9d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.941788] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.941788] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.941788] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.941788] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.941788] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.941788] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 20ba03af-aba0-4fe6-af1e-ea103067fcbe is going to be updated. [ 974.980092] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.980092] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.980092] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.980092] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.980092] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.991315] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 20ba03af-aba0-4fe6-af1e-ea103067fcbe in Status: IN_PROGRESS for 2s [ 975.133651] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a30bbb52-64f6-450b-bd4d-26a201ad310c [ 975.133925] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.134092] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.134141] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.134773] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.134773] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.134773] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a30bbb52-64f6-450b-bd4d-26a201ad310c already deleted. [ 975.134773] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a30bbb52-64f6-450b-bd4d-26a201ad310c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.273864] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock network-934 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.274157] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "network-934" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.274298] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "network-934" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.274738] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "network-934" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.275076] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.275249] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.275480] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.275626] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.275776] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.275996] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 975.276238] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] NeedRegenerationException {{(pid=69232) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 975.276363] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] no value, waiting for create lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 975.276478] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] value creation lock acquired {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 975.276634] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 975.276708] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Calling creation function for not-yet-present value {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 975.276846] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 975.300954] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 975.300954] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=69232) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 975.300954] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Released creation lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 975.301212] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "network-934" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.301549] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock port-336a8c9c-5bd2-4bee-b674-6cb4b1129888 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.302994] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "port-336a8c9c-5bd2-4bee-b674-6cb4b1129888" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.302994] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "port-336a8c9c-5bd2-4bee-b674-6cb4b1129888" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.303320] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "port-336a8c9c-5bd2-4bee-b674-6cb4b1129888" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.303320] env[69232]: DEBUG networking_nsxv3.api.rpc [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('336a8c9c-5bd2-4bee-b674-6cb4b1129888',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.807330] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.808655] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.808655] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.808840] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.810460] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.810460] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Segment Port 336a8c9c-5bd2-4bee-b674-6cb4b1129888 not found, creating... [ 975.810460] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.810460] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.810460] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.810460] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.810460] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.811239] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.811239] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.812994] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.812994] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.812994] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.816381] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Resource: SegmentPort with ID: 336a8c9c-5bd2-4bee-b674-6cb4b1129888 is going to be created. [ 975.820317] env[69232]: INFO networking_nsxv3.common.synchronization [None req-0184bd04-4fe3-4b70-b6ee-53f50867581a tempest-ServersTestFqdnHostnames-1702304883 tempest-ServersTestFqdnHostnames-1702304883-project-member] Enqueued Resource ID: 7c5e8e45-2540-49ab-b0ea-33931f530ce4 with Priority: HIGHEST for action security_group_rules [ 975.821425] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c5e8e45-2540-49ab-b0ea-33931f530ce4 with Priority: HIGHEST for action security_group_rules [ 975.821788] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7c5e8e45-2540-49ab-b0ea-33931f530ce4 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.822349] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7c5e8e45-2540-49ab-b0ea-33931f530ce4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.822418] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7c5e8e45-2540-49ab-b0ea-33931f530ce4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.822698] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7c5e8e45-2540-49ab-b0ea-33931f530ce4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.822783] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7c5e8e45-2540-49ab-b0ea-33931f530ce4',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.847165] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.847484] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.847722] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.847866] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.848127] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.848425] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "port-336a8c9c-5bd2-4bee-b674-6cb4b1129888" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.919370] env[69232]: INFO networking_nsxv3.common.synchronization [None req-30e87dbc-a73c-41e8-86a4-ef9d6520619a tempest-ServersTestFqdnHostnames-1702304883 tempest-ServersTestFqdnHostnames-1702304883-project-member] Enqueued Resource ID: 7c5e8e45-2540-49ab-b0ea-33931f530ce4 with Priority: HIGHEST for action security_group_rules [ 975.919527] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c5e8e45-2540-49ab-b0ea-33931f530ce4 with Priority: HIGHEST for action security_group_rules [ 975.921025] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7c5e8e45-2540-49ab-b0ea-33931f530ce4 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.921025] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7c5e8e45-2540-49ab-b0ea-33931f530ce4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.274245] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 934b2684-b99c-4846-87df-66cbae10f2fc in Status: IN_PROGRESS for 20s [ 976.349183] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.349602] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.349602] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.349602] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.349725] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.349800] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7c5e8e45-2540-49ab-b0ea-33931f530ce4 already deleted. [ 976.349894] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7c5e8e45-2540-49ab-b0ea-33931f530ce4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.350136] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7c5e8e45-2540-49ab-b0ea-33931f530ce4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.350314] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7c5e8e45-2540-49ab-b0ea-33931f530ce4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.350402] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7c5e8e45-2540-49ab-b0ea-33931f530ce4',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.461251] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bdcc7a21-dd0d-4296-ac34-a880ea6123e7 in Status: SUCCESS [ 976.461539] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.716430] env[69232]: INFO networking_nsxv3.common.synchronization [req-aecdbc84-2792-4b9b-8ed6-24d997e9c42c req-acb6f106-c48b-42ee-bad8-85707525e4f1 service nova] Enqueued Resource ID: 83d1cdee-a934-490e-9869-707c6882be9d with Priority: HIGHEST for action security_group_rules [ 976.716430] env[69232]: INFO networking_nsxv3.common.synchronization [req-aecdbc84-2792-4b9b-8ed6-24d997e9c42c req-acb6f106-c48b-42ee-bad8-85707525e4f1 service nova] Enqueued Resource ID: 83d1cdee-a934-490e-9869-707c6882be9d with Priority: HIGHEST for action security_group_members [ 976.717884] env[69232]: INFO networking_nsxv3.common.synchronization [req-aecdbc84-2792-4b9b-8ed6-24d997e9c42c req-acb6f106-c48b-42ee-bad8-85707525e4f1 service nova] Enqueued Resource ID: 336a8c9c-5bd2-4bee-b674-6cb4b1129888 with Priority: HIGHEST for action port [ 976.721418] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83d1cdee-a934-490e-9869-707c6882be9d with Priority: HIGHEST for action security_group_rules [ 976.721418] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83d1cdee-a934-490e-9869-707c6882be9d with Priority: HIGHEST for action security_group_members [ 976.721418] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 336a8c9c-5bd2-4bee-b674-6cb4b1129888 with Priority: HIGHEST for action port [ 976.723332] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-83d1cdee-a934-490e-9869-707c6882be9d taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.723568] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-83d1cdee-a934-490e-9869-707c6882be9d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.723728] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-83d1cdee-a934-490e-9869-707c6882be9d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.724162] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-83d1cdee-a934-490e-9869-707c6882be9d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.724357] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('83d1cdee-a934-490e-9869-707c6882be9d',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.725827] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-83d1cdee-a934-490e-9869-707c6882be9d taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.726045] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-83d1cdee-a934-490e-9869-707c6882be9d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.726174] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-83d1cdee-a934-490e-9869-707c6882be9d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.726468] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-83d1cdee-a934-490e-9869-707c6882be9d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.726735] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.726923] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.727060] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.727323] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.727481] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.727649] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('83d1cdee-a934-490e-9869-707c6882be9d',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.728948] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-336a8c9c-5bd2-4bee-b674-6cb4b1129888 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.729324] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-336a8c9c-5bd2-4bee-b674-6cb4b1129888" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.729477] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-336a8c9c-5bd2-4bee-b674-6cb4b1129888" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.729993] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-336a8c9c-5bd2-4bee-b674-6cb4b1129888" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.729993] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('336a8c9c-5bd2-4bee-b674-6cb4b1129888',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.873965] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.874251] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.874251] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.874504] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.874597] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.874702] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7c5e8e45-2540-49ab-b0ea-33931f530ce4 already deleted. [ 976.874816] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7c5e8e45-2540-49ab-b0ea-33931f530ce4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.002726] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 20ba03af-aba0-4fe6-af1e-ea103067fcbe in Status: SUCCESS [ 977.002956] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-20ba03af-aba0-4fe6-af1e-ea103067fcbe" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.004503] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-20ba03af-aba0-4fe6-af1e-ea103067fcbe" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.004740] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-20ba03af-aba0-4fe6-af1e-ea103067fcbe" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.004936] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.005093] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.005158] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.005323] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.005432] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.005630] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-20ba03af-aba0-4fe6-af1e-ea103067fcbe" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.005705] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('20ba03af-aba0-4fe6-af1e-ea103067fcbe',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.235116] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-83d1cdee-a934-490e-9869-707c6882be9d taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.235116] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-83d1cdee-a934-490e-9869-707c6882be9d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.235116] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('83d1cdee-a934-490e-9869-707c6882be9d',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.235116] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 336a8c9c-5bd2-4bee-b674-6cb4b1129888 with status ACTIVE [ 977.235116] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.235116] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.235116] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.235116] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.235116] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.235116] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.235116] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.235116] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.235116] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.236867] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.236867] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.236867] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.236867] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.236867] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.236867] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.236867] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 336a8c9c-5bd2-4bee-b674-6cb4b1129888 is going to be updated. [ 977.266300] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.266509] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.266509] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.266713] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.266851] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.267022] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-336a8c9c-5bd2-4bee-b674-6cb4b1129888" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.334300] env[69232]: INFO networking_nsxv3.common.synchronization [None req-7d60ceaf-7782-4b29-acd0-e69780a897d3 None None] Enqueued Resource ID: 02e76375-76f4-4574-b5cc-80ee0d08eeb1 with Priority: HIGHEST for action port [ 977.334943] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02e76375-76f4-4574-b5cc-80ee0d08eeb1 with Priority: HIGHEST for action port [ 977.335499] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-02e76375-76f4-4574-b5cc-80ee0d08eeb1 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.335629] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-02e76375-76f4-4574-b5cc-80ee0d08eeb1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.335706] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-02e76375-76f4-4574-b5cc-80ee0d08eeb1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.335950] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-02e76375-76f4-4574-b5cc-80ee0d08eeb1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.336792] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('02e76375-76f4-4574-b5cc-80ee0d08eeb1',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.449983] env[69232]: INFO networking_nsxv3.common.synchronization [req-283304f5-6ede-440f-95a5-a80186adb2a3 req-11deef13-ca85-4d2d-901e-aff267d9acce tempest-ServersAdminTestJSON-2143393640 tempest-ServersAdminTestJSON-2143393640-project-member] Enqueued Resource ID: d2391c01-2410-4874-a5a8-6da2d957e88c with Priority: HIGHEST for action security_group_members [ 977.450806] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2391c01-2410-4874-a5a8-6da2d957e88c with Priority: HIGHEST for action security_group_members [ 977.450943] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2391c01-2410-4874-a5a8-6da2d957e88c taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.451072] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2391c01-2410-4874-a5a8-6da2d957e88c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.452577] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2391c01-2410-4874-a5a8-6da2d957e88c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.453372] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2391c01-2410-4874-a5a8-6da2d957e88c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.453908] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.454067] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.454133] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.454308] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.454396] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.454493] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d2391c01-2410-4874-a5a8-6da2d957e88c',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.509505] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-20ba03af-aba0-4fe6-af1e-ea103067fcbe taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.509720] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-20ba03af-aba0-4fe6-af1e-ea103067fcbe" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.509720] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-20ba03af-aba0-4fe6-af1e-ea103067fcbe" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.509985] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-20ba03af-aba0-4fe6-af1e-ea103067fcbe" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.510174] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.510282] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.510354] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.510556] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.510668] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.510777] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-20ba03af-aba0-4fe6-af1e-ea103067fcbe" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.510940] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-20ba03af-aba0-4fe6-af1e-ea103067fcbe taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.511045] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-20ba03af-aba0-4fe6-af1e-ea103067fcbe" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.511132] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-20ba03af-aba0-4fe6-af1e-ea103067fcbe" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.511858] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-20ba03af-aba0-4fe6-af1e-ea103067fcbe" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.512057] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.512177] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.512260] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.512386] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.512466] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.512547] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-20ba03af-aba0-4fe6-af1e-ea103067fcbe" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.512850] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('20ba03af-aba0-4fe6-af1e-ea103067fcbe',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.740968] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('83d1cdee-a934-490e-9869-707c6882be9d',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.840811] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 02e76375-76f4-4574-b5cc-80ee0d08eeb1 [ 977.840940] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.841371] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.841371] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.841371] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.841644] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.841644] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:02e76375-76f4-4574-b5cc-80ee0d08eeb1 already deleted. [ 977.841754] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-02e76375-76f4-4574-b5cc-80ee0d08eeb1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.957330] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d2391c01-2410-4874-a5a8-6da2d957e88c',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.016823] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 20ba03af-aba0-4fe6-af1e-ea103067fcbe: rpc.has_security_group_logging(os_id): False [ 978.041205] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.041414] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.041414] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.041634] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.041723] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.041962] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.042166] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.042166] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.042332] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.042413] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.042606] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.042703] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.043246] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.043246] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.043246] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.043246] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.043246] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.043475] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.043475] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.043541] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.043590] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 20ba03af-aba0-4fe6-af1e-ea103067fcbe is going to be updated. [ 978.117768] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.118010] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.118010] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.118241] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.118390] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.138311] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 20ba03af-aba0-4fe6-af1e-ea103067fcbe in Status: IN_PROGRESS for 2s [ 978.243897] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.243897] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.243897] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.244149] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.244181] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.244287] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 83d1cdee-a934-490e-9869-707c6882be9d is going to be created. [ 978.283569] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.283706] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.283887] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.284278] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.284559] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.293027] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 934b2684-b99c-4846-87df-66cbae10f2fc in Status: IN_PROGRESS for 22s [ 978.298176] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 83d1cdee-a934-490e-9869-707c6882be9d in Status: UNINITIALIZED for 2s [ 978.463239] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d2391c01-2410-4874-a5a8-6da2d957e88c',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.782886] env[69232]: INFO networking_nsxv3.common.synchronization [req-148f9110-0fcc-47ce-add2-20ab287c5c81 req-44ea4cc1-bd81-4d3e-807a-a214d71f6d5f tempest-ServerActionsV293TestJSON-86347733 tempest-ServerActionsV293TestJSON-86347733-project-member] Enqueued Resource ID: b5e09fe8-8a4e-445c-b1d3-bf8c7339160c with Priority: HIGHEST for action security_group_members [ 978.783464] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5e09fe8-8a4e-445c-b1d3-bf8c7339160c with Priority: HIGHEST for action security_group_members [ 978.783770] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-b5e09fe8-8a4e-445c-b1d3-bf8c7339160c taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.783928] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b5e09fe8-8a4e-445c-b1d3-bf8c7339160c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.783961] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b5e09fe8-8a4e-445c-b1d3-bf8c7339160c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.784468] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b5e09fe8-8a4e-445c-b1d3-bf8c7339160c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.784730] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.784936] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.785065] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.785276] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.785411] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.785546] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b5e09fe8-8a4e-445c-b1d3-bf8c7339160c',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.967025] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.967194] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.967286] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.969086] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.969086] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.969086] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d2391c01-2410-4874-a5a8-6da2d957e88c is going to be updated. [ 979.015156] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.015368] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.015368] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.015586] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.015795] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.030896] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d2391c01-2410-4874-a5a8-6da2d957e88c in Status: IN_PROGRESS for 2s [ 979.288249] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.288471] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.288580] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.288893] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.289043] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.289332] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.289474] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.289566] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.289789] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.290056] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.290189] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b5e09fe8-8a4e-445c-b1d3-bf8c7339160c is going to be updated. [ 979.318187] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.318953] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.318953] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.318953] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.318953] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.328037] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b5e09fe8-8a4e-445c-b1d3-bf8c7339160c in Status: IN_PROGRESS for 2s [ 980.162658] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 20ba03af-aba0-4fe6-af1e-ea103067fcbe in Status: SUCCESS [ 980.163022] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-20ba03af-aba0-4fe6-af1e-ea103067fcbe" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.307947] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 83d1cdee-a934-490e-9869-707c6882be9d in Status: SUCCESS [ 980.308202] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-83d1cdee-a934-490e-9869-707c6882be9d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.308369] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-83d1cdee-a934-490e-9869-707c6882be9d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.308597] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-83d1cdee-a934-490e-9869-707c6882be9d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.308805] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.309434] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.309434] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.309434] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.309434] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.309434] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-83d1cdee-a934-490e-9869-707c6882be9d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.309864] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('83d1cdee-a934-490e-9869-707c6882be9d',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.311406] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 934b2684-b99c-4846-87df-66cbae10f2fc in Status: IN_PROGRESS for 24s [ 980.812790] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-83d1cdee-a934-490e-9869-707c6882be9d taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.813020] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-83d1cdee-a934-490e-9869-707c6882be9d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.813065] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-83d1cdee-a934-490e-9869-707c6882be9d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.813286] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-83d1cdee-a934-490e-9869-707c6882be9d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.813478] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.813577] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.813642] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.813801] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.813891] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.813979] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-83d1cdee-a934-490e-9869-707c6882be9d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.814163] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-83d1cdee-a934-490e-9869-707c6882be9d taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.814262] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-83d1cdee-a934-490e-9869-707c6882be9d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.814340] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-83d1cdee-a934-490e-9869-707c6882be9d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.814486] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-83d1cdee-a934-490e-9869-707c6882be9d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.814624] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.814715] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.814774] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.814910] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.814985] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.815079] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-83d1cdee-a934-490e-9869-707c6882be9d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.815167] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('83d1cdee-a934-490e-9869-707c6882be9d',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.042667] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d2391c01-2410-4874-a5a8-6da2d957e88c in Status: SUCCESS [ 981.042905] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2391c01-2410-4874-a5a8-6da2d957e88c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.318097] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 83d1cdee-a934-490e-9869-707c6882be9d: rpc.has_security_group_logging(os_id): False [ 981.342720] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b5e09fe8-8a4e-445c-b1d3-bf8c7339160c in Status: SUCCESS [ 981.342915] env[69232]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b5e09fe8-8a4e-445c-b1d3-bf8c7339160c deletion is rescheduled due to dependency. [ 981.343123] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b5e09fe8-8a4e-445c-b1d3-bf8c7339160c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.344627] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.344627] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.344627] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.344870] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.344905] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.345074] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.345178] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.345267] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.345395] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.345471] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.345661] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.345754] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.345815] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.345954] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.346040] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.346229] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.346321] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.346379] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.346516] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.346619] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.346657] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 83d1cdee-a934-490e-9869-707c6882be9d is going to be created. [ 981.419137] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.419351] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.419351] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.419575] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.419778] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.435063] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 83d1cdee-a934-490e-9869-707c6882be9d in Status: IN_PROGRESS for 2s [ 981.661627] env[69232]: INFO networking_nsxv3.common.synchronization [req-4d4b0d95-e363-4520-8056-5eef412b1997 req-8bbc717d-c2ad-4724-9315-972e529605c8 tempest-ServerRescueTestJSON-1367609634 tempest-ServerRescueTestJSON-1367609634-project-member] Enqueued Resource ID: 15a3e0ef-3467-49d4-a8b2-072fce21b190 with Priority: HIGHEST for action security_group_members [ 981.663801] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15a3e0ef-3467-49d4-a8b2-072fce21b190 with Priority: HIGHEST for action security_group_members [ 981.663801] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-15a3e0ef-3467-49d4-a8b2-072fce21b190 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.663801] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15a3e0ef-3467-49d4-a8b2-072fce21b190" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.663801] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15a3e0ef-3467-49d4-a8b2-072fce21b190" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.663801] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15a3e0ef-3467-49d4-a8b2-072fce21b190" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.663801] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.663801] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.663801] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.664438] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.664438] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.664438] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('15a3e0ef-3467-49d4-a8b2-072fce21b190',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.870172] env[69232]: INFO networking_nsxv3.common.synchronization [None req-69ffe2d7-2d64-40e2-89fb-e1d48e4695e9 tempest-ServerActionsTestJSON-973196373 tempest-ServerActionsTestJSON-973196373-project-member] Enqueued Resource ID: adac9a54-9bb6-4368-a762-389898a52bd9 with Priority: HIGHEST for action security_group_rules [ 981.870172] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: adac9a54-9bb6-4368-a762-389898a52bd9 with Priority: HIGHEST for action security_group_rules [ 981.870172] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-adac9a54-9bb6-4368-a762-389898a52bd9 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.870172] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-adac9a54-9bb6-4368-a762-389898a52bd9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.870172] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-adac9a54-9bb6-4368-a762-389898a52bd9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.870172] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-adac9a54-9bb6-4368-a762-389898a52bd9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.870172] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('adac9a54-9bb6-4368-a762-389898a52bd9',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.999708] env[69232]: INFO networking_nsxv3.common.synchronization [None req-4e84b4d9-6ea9-4912-ba15-d319e7366abb tempest-ServerActionsTestJSON-973196373 tempest-ServerActionsTestJSON-973196373-project-member] Enqueued Resource ID: adac9a54-9bb6-4368-a762-389898a52bd9 with Priority: HIGHEST for action security_group_rules [ 982.000216] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: adac9a54-9bb6-4368-a762-389898a52bd9 with Priority: HIGHEST for action security_group_rules [ 982.001017] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-adac9a54-9bb6-4368-a762-389898a52bd9 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.001149] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-adac9a54-9bb6-4368-a762-389898a52bd9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.167252] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.167252] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.167466] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.167650] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.167727] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.167897] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.168018] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.168111] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.168282] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.168397] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.168505] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15a3e0ef-3467-49d4-a8b2-072fce21b190 is going to be updated. [ 982.235185] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.235631] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.235739] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.236788] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.236788] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.256986] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15a3e0ef-3467-49d4-a8b2-072fce21b190 in Status: IN_PROGRESS for 2s [ 982.329474] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 934b2684-b99c-4846-87df-66cbae10f2fc in Status: IN_PROGRESS for 26s [ 982.394522] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.394522] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.394522] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.394522] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.394522] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.394522] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: adac9a54-9bb6-4368-a762-389898a52bd9 already deleted. [ 982.394522] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-adac9a54-9bb6-4368-a762-389898a52bd9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.394522] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-adac9a54-9bb6-4368-a762-389898a52bd9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.394522] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-adac9a54-9bb6-4368-a762-389898a52bd9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.394522] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('adac9a54-9bb6-4368-a762-389898a52bd9',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.919662] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.919975] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.920125] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.920518] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.920687] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.920846] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: adac9a54-9bb6-4368-a762-389898a52bd9 already deleted. [ 982.920992] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-adac9a54-9bb6-4368-a762-389898a52bd9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.451267] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 83d1cdee-a934-490e-9869-707c6882be9d in Status: SUCCESS [ 983.451631] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-83d1cdee-a934-490e-9869-707c6882be9d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.794351] env[69232]: INFO networking_nsxv3.common.synchronization [req-3b0a12b4-c23a-4e5d-bed0-0510eeacb61e req-97aeab40-ee7f-4656-a168-ac7da1941466 tempest-ServerRescueNegativeTestJSON-737130981 tempest-ServerRescueNegativeTestJSON-737130981-project-member] Enqueued Resource ID: f29e46f4-baa2-4512-b89f-bb8fa2c53157 with Priority: HIGHEST for action security_group_members [ 983.795028] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f29e46f4-baa2-4512-b89f-bb8fa2c53157 with Priority: HIGHEST for action security_group_members [ 983.795137] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-f29e46f4-baa2-4512-b89f-bb8fa2c53157 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.795219] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f29e46f4-baa2-4512-b89f-bb8fa2c53157" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.795283] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f29e46f4-baa2-4512-b89f-bb8fa2c53157" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.795482] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f29e46f4-baa2-4512-b89f-bb8fa2c53157" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.795634] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.795831] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.795831] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.795923] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.796844] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.796844] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f29e46f4-baa2-4512-b89f-bb8fa2c53157',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.268262] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15a3e0ef-3467-49d4-a8b2-072fce21b190 in Status: SUCCESS [ 984.268501] env[69232]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15a3e0ef-3467-49d4-a8b2-072fce21b190 deletion is rescheduled due to dependency. [ 984.268637] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15a3e0ef-3467-49d4-a8b2-072fce21b190" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.298063] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.298310] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.298426] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.298734] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.325315] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.325658] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.325840] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.325935] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.326218] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.326353] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.326502] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f29e46f4-baa2-4512-b89f-bb8fa2c53157 is going to be updated. [ 984.344103] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 934b2684-b99c-4846-87df-66cbae10f2fc in Status: IN_PROGRESS for 28s [ 984.360843] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.361218] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.361218] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.361424] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.361424] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.371616] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f29e46f4-baa2-4512-b89f-bb8fa2c53157 in Status: IN_PROGRESS for 2s [ 984.788039] env[69232]: INFO networking_nsxv3.common.synchronization [req-9daa1030-ce68-4ac1-90ac-7146fed4f928 req-bbac9236-5ed1-4545-8c69-ec9d16f3bc81 tempest-ServersTestJSON-524901877 tempest-ServersTestJSON-524901877-project-member] Enqueued Resource ID: bdcc7a21-dd0d-4296-ac34-a880ea6123e7 with Priority: HIGHEST for action security_group_members [ 984.788567] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdcc7a21-dd0d-4296-ac34-a880ea6123e7 with Priority: HIGHEST for action security_group_members [ 984.788879] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.788992] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.789082] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.789274] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.789449] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.789513] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.789581] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.789724] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.789808] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.789902] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bdcc7a21-dd0d-4296-ac34-a880ea6123e7',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.292468] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bdcc7a21-dd0d-4296-ac34-a880ea6123e7',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.795438] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bdcc7a21-dd0d-4296-ac34-a880ea6123e7',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.299271] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.299434] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.299508] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.299728] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.299822] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.299937] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bdcc7a21-dd0d-4296-ac34-a880ea6123e7 is going to be updated. [ 986.339557] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.339714] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.339785] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.340065] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.340226] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.351914] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bdcc7a21-dd0d-4296-ac34-a880ea6123e7 in Status: IN_PROGRESS for 2s [ 986.359405] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 934b2684-b99c-4846-87df-66cbae10f2fc in Status: IN_PROGRESS for 30s [ 986.394980] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f29e46f4-baa2-4512-b89f-bb8fa2c53157 in Status: SUCCESS [ 986.395207] env[69232]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f29e46f4-baa2-4512-b89f-bb8fa2c53157 deletion is rescheduled due to dependency. [ 986.395207] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f29e46f4-baa2-4512-b89f-bb8fa2c53157" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.804406] env[69232]: INFO networking_nsxv3.common.synchronization [req-7edc728a-eed9-4300-ab1a-47baa84a39c4 req-bef5258f-7b58-4097-a0f1-c26596512a15 tempest-ListServerFiltersTestJSON-193943041 tempest-ListServerFiltersTestJSON-193943041-project-member] Enqueued Resource ID: 8f8cfd9d-acc3-4fa8-825d-c583365a30ed with Priority: HIGHEST for action security_group_members [ 987.806018] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f8cfd9d-acc3-4fa8-825d-c583365a30ed with Priority: HIGHEST for action security_group_members [ 987.806018] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f8cfd9d-acc3-4fa8-825d-c583365a30ed taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.806018] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f8cfd9d-acc3-4fa8-825d-c583365a30ed" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.806018] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f8cfd9d-acc3-4fa8-825d-c583365a30ed" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.806253] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f8cfd9d-acc3-4fa8-825d-c583365a30ed" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.809908] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.809908] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.809908] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.809908] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.809908] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.809908] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8f8cfd9d-acc3-4fa8-825d-c583365a30ed',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.310846] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8f8cfd9d-acc3-4fa8-825d-c583365a30ed',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.362787] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bdcc7a21-dd0d-4296-ac34-a880ea6123e7 in Status: SUCCESS [ 988.363315] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.374254] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 934b2684-b99c-4846-87df-66cbae10f2fc in Status: IN_PROGRESS for 32s [ 988.814014] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8f8cfd9d-acc3-4fa8-825d-c583365a30ed',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.316834] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.317074] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.317162] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.317481] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.317593] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.317698] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8f8cfd9d-acc3-4fa8-825d-c583365a30ed is going to be updated. [ 989.326686] env[69232]: INFO networking_nsxv3.common.synchronization [req-7b79c02f-6d20-4dae-9d7e-30bb6024d9de req-bddb9af8-28ab-454d-b8d6-c1844c57393e tempest-AttachInterfacesTestJSON-1442903876 tempest-AttachInterfacesTestJSON-1442903876-project-member] Enqueued Resource ID: 20ba03af-aba0-4fe6-af1e-ea103067fcbe with Priority: HIGHEST for action security_group_members [ 989.327114] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20ba03af-aba0-4fe6-af1e-ea103067fcbe with Priority: HIGHEST for action security_group_members [ 989.327429] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-20ba03af-aba0-4fe6-af1e-ea103067fcbe taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.327508] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-20ba03af-aba0-4fe6-af1e-ea103067fcbe" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.327592] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-20ba03af-aba0-4fe6-af1e-ea103067fcbe" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.327770] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-20ba03af-aba0-4fe6-af1e-ea103067fcbe" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.327953] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.329488] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.329584] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.329719] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.329807] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.330205] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('20ba03af-aba0-4fe6-af1e-ea103067fcbe',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.364022] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.364022] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.364022] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.364022] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.364022] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.375323] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f8cfd9d-acc3-4fa8-825d-c583365a30ed in Status: IN_PROGRESS for 2s [ 989.833950] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('20ba03af-aba0-4fe6-af1e-ea103067fcbe',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.069524] env[69232]: INFO networking_nsxv3.common.synchronization [None req-229b2677-0b79-49a3-99fc-a2b908f1f741 tempest-AttachInterfacesTestJSON-1442903876 tempest-AttachInterfacesTestJSON-1442903876-project-member] Enqueued Resource ID: 20ba03af-aba0-4fe6-af1e-ea103067fcbe with Priority: HIGHEST for action security_group_members [ 990.070421] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20ba03af-aba0-4fe6-af1e-ea103067fcbe with Priority: HIGHEST for action security_group_members [ 990.070905] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-20ba03af-aba0-4fe6-af1e-ea103067fcbe taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.071085] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-20ba03af-aba0-4fe6-af1e-ea103067fcbe" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.338973] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('20ba03af-aba0-4fe6-af1e-ea103067fcbe',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.394756] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 934b2684-b99c-4846-87df-66cbae10f2fc in Status: IN_PROGRESS for 34s [ 990.842460] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.842799] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.842799] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.843031] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.843168] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.843307] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 20ba03af-aba0-4fe6-af1e-ea103067fcbe is going to be updated. [ 990.875256] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.875410] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.875459] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.875671] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.875932] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.886214] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 20ba03af-aba0-4fe6-af1e-ea103067fcbe in Status: IN_PROGRESS for 2s [ 991.388015] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f8cfd9d-acc3-4fa8-825d-c583365a30ed in Status: SUCCESS [ 991.388388] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f8cfd9d-acc3-4fa8-825d-c583365a30ed" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.408041] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 934b2684-b99c-4846-87df-66cbae10f2fc in Status: IN_PROGRESS for 36s [ 992.900224] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 20ba03af-aba0-4fe6-af1e-ea103067fcbe in Status: SUCCESS [ 992.900507] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-20ba03af-aba0-4fe6-af1e-ea103067fcbe" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.900873] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-20ba03af-aba0-4fe6-af1e-ea103067fcbe" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.901151] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-20ba03af-aba0-4fe6-af1e-ea103067fcbe" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.901347] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.901485] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.901567] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.901994] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.901994] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.903574] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('20ba03af-aba0-4fe6-af1e-ea103067fcbe',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.406897] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.407074] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.407148] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.407406] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.407517] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.407748] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.407863] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.407932] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.409666] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.409922] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.409922] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 20ba03af-aba0-4fe6-af1e-ea103067fcbe is going to be updated. [ 993.444297] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.444559] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.444641] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.444875] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.445017] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.461231] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 20ba03af-aba0-4fe6-af1e-ea103067fcbe in Status: IN_PROGRESS for 2s [ 993.724550] env[69232]: INFO networking_nsxv3.common.synchronization [None req-9063fff0-fe47-4159-933b-c9cab1c9170a tempest-AttachVolumeNegativeTest-731570695 tempest-AttachVolumeNegativeTest-731570695-project-member] Enqueued Resource ID: 8e5c2d57-e29a-48c5-977d-f19d1fe77c00 with Priority: HIGHEST for action security_group_rules [ 993.725153] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e5c2d57-e29a-48c5-977d-f19d1fe77c00 with Priority: HIGHEST for action security_group_rules [ 993.725500] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8e5c2d57-e29a-48c5-977d-f19d1fe77c00 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.725618] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8e5c2d57-e29a-48c5-977d-f19d1fe77c00" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.725696] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8e5c2d57-e29a-48c5-977d-f19d1fe77c00" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.726177] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8e5c2d57-e29a-48c5-977d-f19d1fe77c00" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.726444] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8e5c2d57-e29a-48c5-977d-f19d1fe77c00',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.847141] env[69232]: INFO networking_nsxv3.common.synchronization [None req-d16198e8-1d62-4fa8-b221-b467bfbd8a29 tempest-AttachVolumeNegativeTest-731570695 tempest-AttachVolumeNegativeTest-731570695-project-member] Enqueued Resource ID: 8e5c2d57-e29a-48c5-977d-f19d1fe77c00 with Priority: HIGHEST for action security_group_rules [ 993.847141] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e5c2d57-e29a-48c5-977d-f19d1fe77c00 with Priority: HIGHEST for action security_group_rules [ 993.847141] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8e5c2d57-e29a-48c5-977d-f19d1fe77c00 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.847141] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8e5c2d57-e29a-48c5-977d-f19d1fe77c00" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.977379] env[69232]: INFO networking_nsxv3.common.synchronization [req-ca349670-7d04-4b1f-8b6a-7c65f1ba9c6e req-225b2168-cfd2-479c-b712-b743b8a56153 tempest-ServerActionsTestOtherA-781098598 tempest-ServerActionsTestOtherA-781098598-project-member] Enqueued Resource ID: e18d5d2b-f965-404d-b211-f58621ceccf1 with Priority: HIGHEST for action security_group_members [ 993.977656] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e18d5d2b-f965-404d-b211-f58621ceccf1 with Priority: HIGHEST for action security_group_members [ 993.978163] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-e18d5d2b-f965-404d-b211-f58621ceccf1 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.978330] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e18d5d2b-f965-404d-b211-f58621ceccf1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.978330] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e18d5d2b-f965-404d-b211-f58621ceccf1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.978527] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e18d5d2b-f965-404d-b211-f58621ceccf1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.978704] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.978807] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.978857] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.979236] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.979236] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.979236] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e18d5d2b-f965-404d-b211-f58621ceccf1',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.254025] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.254025] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.254025] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.254025] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.254025] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.254025] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8e5c2d57-e29a-48c5-977d-f19d1fe77c00 already deleted. [ 994.254025] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8e5c2d57-e29a-48c5-977d-f19d1fe77c00" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.254025] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8e5c2d57-e29a-48c5-977d-f19d1fe77c00" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.254025] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8e5c2d57-e29a-48c5-977d-f19d1fe77c00" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.254025] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8e5c2d57-e29a-48c5-977d-f19d1fe77c00',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.424780] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 934b2684-b99c-4846-87df-66cbae10f2fc in Status: IN_PROGRESS for 38s [ 994.482761] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.483460] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.483637] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.484101] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.484413] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.484843] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.485159] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.485322] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.485614] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.486346] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.486346] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e18d5d2b-f965-404d-b211-f58621ceccf1 already deleted. [ 994.486346] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e18d5d2b-f965-404d-b211-f58621ceccf1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.778876] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.779612] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.780685] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.780685] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.780685] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.780685] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8e5c2d57-e29a-48c5-977d-f19d1fe77c00 already deleted. [ 994.780685] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8e5c2d57-e29a-48c5-977d-f19d1fe77c00" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.914579] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock network-421 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.914767] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "network-421" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.916271] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "network-421" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.916632] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "network-421" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.916963] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.917160] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.917310] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.917574] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.917757] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.918390] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 994.918853] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] NeedRegenerationException {{(pid=69232) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 994.918853] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] no value, waiting for create lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 994.918853] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] value creation lock acquired {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 994.919128] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 994.919186] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Calling creation function for not-yet-present value {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 994.919338] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 994.940121] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 994.940344] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69232) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 994.940699] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Released creation lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 994.940699] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "network-421" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.941048] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock port-0b240255-7a1b-4a4f-a2a9-b61abf239996 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.943586] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "port-0b240255-7a1b-4a4f-a2a9-b61abf239996" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.943586] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "port-0b240255-7a1b-4a4f-a2a9-b61abf239996" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.943586] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "port-0b240255-7a1b-4a4f-a2a9-b61abf239996" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.943586] env[69232]: DEBUG networking_nsxv3.api.rpc [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0b240255-7a1b-4a4f-a2a9-b61abf239996',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.446909] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.447350] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.447350] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.447540] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.447811] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.447954] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Segment Port 0b240255-7a1b-4a4f-a2a9-b61abf239996 not found, creating... [ 995.448250] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.448421] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.448565] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.448846] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.448982] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.449398] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.449541] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.449682] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.449927] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.452015] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.452015] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Resource: SegmentPort with ID: 0b240255-7a1b-4a4f-a2a9-b61abf239996 is going to be created. [ 995.470827] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 20ba03af-aba0-4fe6-af1e-ea103067fcbe in Status: SUCCESS [ 995.471014] env[69232]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 20ba03af-aba0-4fe6-af1e-ea103067fcbe deletion is rescheduled due to dependency. [ 995.471144] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-20ba03af-aba0-4fe6-af1e-ea103067fcbe" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.475428] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.475670] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.475763] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.476084] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.476357] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.476531] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "port-0b240255-7a1b-4a4f-a2a9-b61abf239996" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.447138] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 934b2684-b99c-4846-87df-66cbae10f2fc in Status: IN_PROGRESS for 40s [ 996.559941] env[69232]: INFO networking_nsxv3.common.synchronization [req-ca349670-7d04-4b1f-8b6a-7c65f1ba9c6e req-fba7e614-4425-47a4-972f-813973e4a23f service nova] Enqueued Resource ID: e18d5d2b-f965-404d-b211-f58621ceccf1 with Priority: HIGHEST for action security_group_rules [ 996.559941] env[69232]: INFO networking_nsxv3.common.synchronization [req-ca349670-7d04-4b1f-8b6a-7c65f1ba9c6e req-fba7e614-4425-47a4-972f-813973e4a23f service nova] Enqueued Resource ID: e18d5d2b-f965-404d-b211-f58621ceccf1 with Priority: HIGHEST for action security_group_members [ 996.559941] env[69232]: INFO networking_nsxv3.common.synchronization [req-ca349670-7d04-4b1f-8b6a-7c65f1ba9c6e req-fba7e614-4425-47a4-972f-813973e4a23f service nova] Enqueued Resource ID: 0b240255-7a1b-4a4f-a2a9-b61abf239996 with Priority: HIGHEST for action port [ 996.560183] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e18d5d2b-f965-404d-b211-f58621ceccf1 with Priority: HIGHEST for action security_group_rules [ 996.560306] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e18d5d2b-f965-404d-b211-f58621ceccf1 with Priority: HIGHEST for action security_group_members [ 996.560441] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b240255-7a1b-4a4f-a2a9-b61abf239996 with Priority: HIGHEST for action port [ 996.562964] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e18d5d2b-f965-404d-b211-f58621ceccf1 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.563162] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e18d5d2b-f965-404d-b211-f58621ceccf1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.563250] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e18d5d2b-f965-404d-b211-f58621ceccf1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.563519] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e18d5d2b-f965-404d-b211-f58621ceccf1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.563644] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e18d5d2b-f965-404d-b211-f58621ceccf1',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.566189] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-e18d5d2b-f965-404d-b211-f58621ceccf1 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.566335] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e18d5d2b-f965-404d-b211-f58621ceccf1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.566407] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e18d5d2b-f965-404d-b211-f58621ceccf1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.566621] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e18d5d2b-f965-404d-b211-f58621ceccf1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.566827] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.566930] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.566994] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.567187] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.567278] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.567384] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e18d5d2b-f965-404d-b211-f58621ceccf1',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.568302] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-0b240255-7a1b-4a4f-a2a9-b61abf239996 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.568419] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0b240255-7a1b-4a4f-a2a9-b61abf239996" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.568487] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0b240255-7a1b-4a4f-a2a9-b61abf239996" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.568644] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0b240255-7a1b-4a4f-a2a9-b61abf239996" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.568734] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0b240255-7a1b-4a4f-a2a9-b61abf239996',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.071008] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-e18d5d2b-f965-404d-b211-f58621ceccf1 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.071194] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e18d5d2b-f965-404d-b211-f58621ceccf1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.071416] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e18d5d2b-f965-404d-b211-f58621ceccf1',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.072620] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0b240255-7a1b-4a4f-a2a9-b61abf239996 with status ACTIVE [ 997.072730] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.072825] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.072890] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.073186] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.073186] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.073359] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.073457] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.073518] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.073675] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.073746] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.073925] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.075441] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.075555] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.075739] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.075823] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.075947] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0b240255-7a1b-4a4f-a2a9-b61abf239996 is going to be updated. [ 997.108828] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.108828] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.108828] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.109088] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.109088] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.109183] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0b240255-7a1b-4a4f-a2a9-b61abf239996" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.234680] env[69232]: INFO networking_nsxv3.common.synchronization [None req-ab31b879-c865-4ba5-b8f4-078ae0689036 None None] Enqueued Resource ID: 86b14486-fb06-4c9a-9bad-709b90de3fab with Priority: HIGHEST for action port [ 997.235155] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 86b14486-fb06-4c9a-9bad-709b90de3fab with Priority: HIGHEST for action port [ 997.236875] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-86b14486-fb06-4c9a-9bad-709b90de3fab taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.236875] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-86b14486-fb06-4c9a-9bad-709b90de3fab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.236875] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-86b14486-fb06-4c9a-9bad-709b90de3fab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.236875] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-86b14486-fb06-4c9a-9bad-709b90de3fab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.236875] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('86b14486-fb06-4c9a-9bad-709b90de3fab',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.578254] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e18d5d2b-f965-404d-b211-f58621ceccf1',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.740396] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 86b14486-fb06-4c9a-9bad-709b90de3fab [ 997.740396] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.740396] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.740396] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.740576] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.740576] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.740697] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:86b14486-fb06-4c9a-9bad-709b90de3fab already deleted. [ 997.740738] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-86b14486-fb06-4c9a-9bad-709b90de3fab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.081355] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.081936] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.082047] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.082329] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.082453] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.082653] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e18d5d2b-f965-404d-b211-f58621ceccf1 is going to be created. [ 998.118180] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.118420] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.118488] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.118736] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.118935] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.132751] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e18d5d2b-f965-404d-b211-f58621ceccf1 in Status: UNINITIALIZED for 2s [ 998.399327] env[69232]: INFO networking_nsxv3.common.synchronization [None req-43ea9c56-fc94-4910-9bc9-7f2fcc4dc73e None None] Enqueued Resource ID: 68f8e695-fe65-4610-9b9d-f4cd95a8d575 with Priority: HIGHEST for action port [ 998.399592] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68f8e695-fe65-4610-9b9d-f4cd95a8d575 with Priority: HIGHEST for action port [ 998.400515] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-68f8e695-fe65-4610-9b9d-f4cd95a8d575 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.400631] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-68f8e695-fe65-4610-9b9d-f4cd95a8d575" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.402117] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-68f8e695-fe65-4610-9b9d-f4cd95a8d575" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.402993] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-68f8e695-fe65-4610-9b9d-f4cd95a8d575" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.402993] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('68f8e695-fe65-4610-9b9d-f4cd95a8d575',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.462881] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 934b2684-b99c-4846-87df-66cbae10f2fc in Status: IN_PROGRESS for 42s [ 998.908281] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 68f8e695-fe65-4610-9b9d-f4cd95a8d575 [ 998.908851] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.908851] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.908851] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.909081] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.909081] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.909220] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:68f8e695-fe65-4610-9b9d-f4cd95a8d575 already deleted. [ 998.909277] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-68f8e695-fe65-4610-9b9d-f4cd95a8d575" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.251119] env[69232]: INFO networking_nsxv3.common.synchronization [req-ba574be4-52cc-4df7-b8f9-ae8d4e8dc83f req-22902286-6bfc-45c4-ae80-1cc160303af3 tempest-ImagesTestJSON-1245210724 tempest-ImagesTestJSON-1245210724-project-member] Enqueued Resource ID: fb3494b9-4ce5-4744-a378-ecbcd5c2bec9 with Priority: HIGHEST for action security_group_members [ 999.251119] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb3494b9-4ce5-4744-a378-ecbcd5c2bec9 with Priority: HIGHEST for action security_group_members [ 999.251119] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.251119] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.251930] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.252366] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.252791] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.254794] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.254794] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.254794] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.254794] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.254794] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fb3494b9-4ce5-4744-a378-ecbcd5c2bec9',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.528347] env[69232]: INFO networking_nsxv3.common.synchronization [req-19ab0e2c-f658-447d-a9e2-fdfc3c6383b2 req-56212e0b-0dff-4540-88d8-03dbaff0494b tempest-AttachInterfacesTestJSON-1442903876 tempest-AttachInterfacesTestJSON-1442903876-project-member] Enqueued Resource ID: 4843729c-bd07-48e1-9798-7dc90829718d with Priority: HIGHEST for action security_group_members [ 999.528862] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4843729c-bd07-48e1-9798-7dc90829718d with Priority: HIGHEST for action security_group_members [ 999.529166] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-4843729c-bd07-48e1-9798-7dc90829718d taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.529288] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4843729c-bd07-48e1-9798-7dc90829718d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.529342] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4843729c-bd07-48e1-9798-7dc90829718d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.529537] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4843729c-bd07-48e1-9798-7dc90829718d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.529682] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.529774] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.529827] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.529967] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.531597] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.531710] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4843729c-bd07-48e1-9798-7dc90829718d',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.756095] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.756363] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.756363] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.756561] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.756646] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.756865] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.757034] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.757034] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.757198] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.757272] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.757345] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb3494b9-4ce5-4744-a378-ecbcd5c2bec9 is going to be updated. [ 999.793634] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.793634] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.793634] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.793634] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.796019] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.805550] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb3494b9-4ce5-4744-a378-ecbcd5c2bec9 in Status: IN_PROGRESS for 2s [ 999.862722] env[69232]: INFO networking_nsxv3.common.synchronization [None req-4a6c32d4-c225-444d-aa5c-cff0296d74b5 None None] Enqueued Resource ID: 494dfdba-a7c7-45ae-99ee-f8538a0f9c57 with Priority: HIGHEST for action port [ 999.862997] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 494dfdba-a7c7-45ae-99ee-f8538a0f9c57 with Priority: HIGHEST for action port [ 999.863721] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-494dfdba-a7c7-45ae-99ee-f8538a0f9c57 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.864790] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-494dfdba-a7c7-45ae-99ee-f8538a0f9c57" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.864878] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-494dfdba-a7c7-45ae-99ee-f8538a0f9c57" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.865450] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-494dfdba-a7c7-45ae-99ee-f8538a0f9c57" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.865450] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('494dfdba-a7c7-45ae-99ee-f8538a0f9c57',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.036655] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.036655] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.036655] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.036655] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.060708] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.061050] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.061050] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.061050] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.061200] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.061300] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.063037] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4843729c-bd07-48e1-9798-7dc90829718d is going to be updated. [ 1000.097672] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.097821] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.097890] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.098126] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.098277] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.108896] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4843729c-bd07-48e1-9798-7dc90829718d in Status: IN_PROGRESS for 2s [ 1000.142273] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e18d5d2b-f965-404d-b211-f58621ceccf1 in Status: SUCCESS [ 1000.142492] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e18d5d2b-f965-404d-b211-f58621ceccf1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.142660] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e18d5d2b-f965-404d-b211-f58621ceccf1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.142869] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e18d5d2b-f965-404d-b211-f58621ceccf1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.143070] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.143258] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.143258] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.143391] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.143472] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.143555] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e18d5d2b-f965-404d-b211-f58621ceccf1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.143743] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e18d5d2b-f965-404d-b211-f58621ceccf1',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.367757] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 494dfdba-a7c7-45ae-99ee-f8538a0f9c57 [ 1000.369623] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.369623] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.369623] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.369623] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.369623] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.369623] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:494dfdba-a7c7-45ae-99ee-f8538a0f9c57 already deleted. [ 1000.369623] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-494dfdba-a7c7-45ae-99ee-f8538a0f9c57" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.503731] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 934b2684-b99c-4846-87df-66cbae10f2fc in Status: IN_PROGRESS for 44s [ 1000.646128] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-e18d5d2b-f965-404d-b211-f58621ceccf1 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.646388] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e18d5d2b-f965-404d-b211-f58621ceccf1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.646529] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e18d5d2b-f965-404d-b211-f58621ceccf1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.646847] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e18d5d2b-f965-404d-b211-f58621ceccf1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.647120] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.647290] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.647402] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.647651] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.647800] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.647941] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e18d5d2b-f965-404d-b211-f58621ceccf1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.648183] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-e18d5d2b-f965-404d-b211-f58621ceccf1 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.648318] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e18d5d2b-f965-404d-b211-f58621ceccf1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.648423] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e18d5d2b-f965-404d-b211-f58621ceccf1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.648624] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e18d5d2b-f965-404d-b211-f58621ceccf1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.648835] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.648983] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.649957] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.650311] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.650594] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.650811] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e18d5d2b-f965-404d-b211-f58621ceccf1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.651047] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e18d5d2b-f965-404d-b211-f58621ceccf1',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.155391] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e18d5d2b-f965-404d-b211-f58621ceccf1: rpc.has_security_group_logging(os_id): False [ 1001.195306] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.195306] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.195306] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.195860] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.195860] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.195860] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.196074] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.196074] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.196199] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.196275] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.196477] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.196578] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.196820] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.196820] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.196919] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.197302] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.197477] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.197582] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.197810] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.197896] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.198036] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e18d5d2b-f965-404d-b211-f58621ceccf1 is going to be created. [ 1001.271453] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.271453] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.271453] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.271453] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.271453] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.293780] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e18d5d2b-f965-404d-b211-f58621ceccf1 in Status: IN_PROGRESS for 2s [ 1001.719859] env[69232]: INFO networking_nsxv3.common.synchronization [None req-2b93acea-07ce-4f09-83ca-fe75b909f12a None None] Enqueued Resource ID: 6d3d31c5-c4d5-4de5-ae11-369cf859f412 with Priority: HIGHEST for action port [ 1001.719859] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d3d31c5-c4d5-4de5-ae11-369cf859f412 with Priority: HIGHEST for action port [ 1001.720456] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-6d3d31c5-c4d5-4de5-ae11-369cf859f412 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.720456] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6d3d31c5-c4d5-4de5-ae11-369cf859f412" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.720456] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6d3d31c5-c4d5-4de5-ae11-369cf859f412" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.720754] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6d3d31c5-c4d5-4de5-ae11-369cf859f412" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.720754] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6d3d31c5-c4d5-4de5-ae11-369cf859f412',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.816904] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb3494b9-4ce5-4744-a378-ecbcd5c2bec9 in Status: SUCCESS [ 1001.817178] env[69232]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb3494b9-4ce5-4744-a378-ecbcd5c2bec9 deletion is rescheduled due to dependency. [ 1001.817326] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.123763] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4843729c-bd07-48e1-9798-7dc90829718d in Status: SUCCESS [ 1002.123763] env[69232]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4843729c-bd07-48e1-9798-7dc90829718d deletion is rescheduled due to dependency. [ 1002.123868] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4843729c-bd07-48e1-9798-7dc90829718d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.223650] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6d3d31c5-c4d5-4de5-ae11-369cf859f412 [ 1002.224245] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.224640] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.224748] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.225117] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.225282] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.225439] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6d3d31c5-c4d5-4de5-ae11-369cf859f412 already deleted. [ 1002.225558] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6d3d31c5-c4d5-4de5-ae11-369cf859f412" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.511260] env[69232]: INFO networking_nsxv3.common.synchronization [req-01091527-29ea-4c85-a1d0-a1f0d9eb43c6 req-1c1cbdfa-c310-4e4a-a103-28acbd9efd41 tempest-ServersTestFqdnHostnames-1702304883 tempest-ServersTestFqdnHostnames-1702304883-project-member] Enqueued Resource ID: 7c5e8e45-2540-49ab-b0ea-33931f530ce4 with Priority: HIGHEST for action security_group_members [ 1002.511884] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c5e8e45-2540-49ab-b0ea-33931f530ce4 with Priority: HIGHEST for action security_group_members [ 1002.511984] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c5e8e45-2540-49ab-b0ea-33931f530ce4 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.515508] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c5e8e45-2540-49ab-b0ea-33931f530ce4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.515673] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c5e8e45-2540-49ab-b0ea-33931f530ce4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.517011] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c5e8e45-2540-49ab-b0ea-33931f530ce4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.517085] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.517229] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.517314] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.517504] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.517595] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.517696] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7c5e8e45-2540-49ab-b0ea-33931f530ce4',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.520596] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 934b2684-b99c-4846-87df-66cbae10f2fc in Status: IN_PROGRESS for 46s [ 1003.022421] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.022693] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.022913] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.023408] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.023584] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.023934] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.024236] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.024236] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.024493] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.024622] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.024760] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7c5e8e45-2540-49ab-b0ea-33931f530ce4 already deleted. [ 1003.025029] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c5e8e45-2540-49ab-b0ea-33931f530ce4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.223359] env[69232]: INFO networking_nsxv3.common.synchronization [req-28fdf55a-e46c-4077-8b0c-e312ffdcdeba req-2969cd1f-8fba-48c8-9db6-0846a65236c9 tempest-ServersAdminTestJSON-2143393640 tempest-ServersAdminTestJSON-2143393640-project-member] Enqueued Resource ID: d2391c01-2410-4874-a5a8-6da2d957e88c with Priority: HIGHEST for action security_group_members [ 1003.224452] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2391c01-2410-4874-a5a8-6da2d957e88c with Priority: HIGHEST for action security_group_members [ 1003.224805] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2391c01-2410-4874-a5a8-6da2d957e88c taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.225022] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2391c01-2410-4874-a5a8-6da2d957e88c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.225149] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2391c01-2410-4874-a5a8-6da2d957e88c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.225701] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2391c01-2410-4874-a5a8-6da2d957e88c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.225701] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.225849] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.226489] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.226489] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.226489] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.226489] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d2391c01-2410-4874-a5a8-6da2d957e88c',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.292403] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock network-773 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.293532] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "network-773" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.293714] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "network-773" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.294104] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "network-773" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.294506] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.294745] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.294904] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.295301] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.295507] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.295762] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1003.295914] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] NeedRegenerationException {{(pid=69232) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1003.296129] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] no value, waiting for create lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1003.296206] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] value creation lock acquired {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1003.296354] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1003.296494] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Calling creation function for not-yet-present value {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1003.296657] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1003.323999] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1003.323999] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=69232) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1003.323999] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Released creation lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1003.323999] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "network-773" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.323999] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock port-aadbeef4-bdd4-4778-a717-902878bc8957 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.323999] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "port-aadbeef4-bdd4-4778-a717-902878bc8957" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.323999] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "port-aadbeef4-bdd4-4778-a717-902878bc8957" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.323999] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "port-aadbeef4-bdd4-4778-a717-902878bc8957" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.323999] env[69232]: DEBUG networking_nsxv3.api.rpc [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aadbeef4-bdd4-4778-a717-902878bc8957',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.326034] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e18d5d2b-f965-404d-b211-f58621ceccf1 in Status: SUCCESS [ 1003.326226] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e18d5d2b-f965-404d-b211-f58621ceccf1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.729554] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d2391c01-2410-4874-a5a8-6da2d957e88c',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.826866] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.827395] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.827566] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.827953] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.828353] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.829451] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Segment Port aadbeef4-bdd4-4778-a717-902878bc8957 not found, creating... [ 1003.829451] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.829451] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.829451] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.829990] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.830180] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.830421] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.830585] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.830707] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.830949] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.831099] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.831252] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Resource: SegmentPort with ID: aadbeef4-bdd4-4778-a717-902878bc8957 is going to be created. [ 1003.867377] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.867377] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.867747] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.867747] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.867984] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.868239] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "port-aadbeef4-bdd4-4778-a717-902878bc8957" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.235875] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d2391c01-2410-4874-a5a8-6da2d957e88c',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.535309] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 934b2684-b99c-4846-87df-66cbae10f2fc in Status: IN_PROGRESS for 48s [ 1004.739054] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.739267] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.739466] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.739738] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.739852] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.739973] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d2391c01-2410-4874-a5a8-6da2d957e88c is going to be updated. [ 1004.776136] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.776308] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.776384] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.776630] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.776807] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.786957] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d2391c01-2410-4874-a5a8-6da2d957e88c in Status: IN_PROGRESS for 2s [ 1004.792243] env[69232]: INFO networking_nsxv3.common.synchronization [req-01091527-29ea-4c85-a1d0-a1f0d9eb43c6 req-4f33fad3-595f-4ed8-9760-f093e93b1fb5 service nova] Enqueued Resource ID: 7c5e8e45-2540-49ab-b0ea-33931f530ce4 with Priority: HIGHEST for action security_group_rules [ 1004.792465] env[69232]: INFO networking_nsxv3.common.synchronization [req-01091527-29ea-4c85-a1d0-a1f0d9eb43c6 req-4f33fad3-595f-4ed8-9760-f093e93b1fb5 service nova] Enqueued Resource ID: 7c5e8e45-2540-49ab-b0ea-33931f530ce4 with Priority: HIGHEST for action security_group_members [ 1004.792600] env[69232]: INFO networking_nsxv3.common.synchronization [req-01091527-29ea-4c85-a1d0-a1f0d9eb43c6 req-4f33fad3-595f-4ed8-9760-f093e93b1fb5 service nova] Enqueued Resource ID: aadbeef4-bdd4-4778-a717-902878bc8957 with Priority: HIGHEST for action port [ 1004.792843] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c5e8e45-2540-49ab-b0ea-33931f530ce4 with Priority: HIGHEST for action security_group_rules [ 1004.792977] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c5e8e45-2540-49ab-b0ea-33931f530ce4 with Priority: HIGHEST for action security_group_members [ 1004.793150] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aadbeef4-bdd4-4778-a717-902878bc8957 with Priority: HIGHEST for action port [ 1004.793810] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7c5e8e45-2540-49ab-b0ea-33931f530ce4 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.793882] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7c5e8e45-2540-49ab-b0ea-33931f530ce4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.793924] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7c5e8e45-2540-49ab-b0ea-33931f530ce4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.794335] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7c5e8e45-2540-49ab-b0ea-33931f530ce4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.794335] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7c5e8e45-2540-49ab-b0ea-33931f530ce4',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.798196] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c5e8e45-2540-49ab-b0ea-33931f530ce4 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.798196] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c5e8e45-2540-49ab-b0ea-33931f530ce4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.798196] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c5e8e45-2540-49ab-b0ea-33931f530ce4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.798196] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c5e8e45-2540-49ab-b0ea-33931f530ce4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.798196] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.798196] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.798196] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.798196] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.798196] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.798196] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7c5e8e45-2540-49ab-b0ea-33931f530ce4',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.799631] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-aadbeef4-bdd4-4778-a717-902878bc8957 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.799631] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aadbeef4-bdd4-4778-a717-902878bc8957" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.799631] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aadbeef4-bdd4-4778-a717-902878bc8957" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.799631] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aadbeef4-bdd4-4778-a717-902878bc8957" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.799631] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aadbeef4-bdd4-4778-a717-902878bc8957',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.301057] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7c5e8e45-2540-49ab-b0ea-33931f530ce4',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.301628] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c5e8e45-2540-49ab-b0ea-33931f530ce4 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.301628] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c5e8e45-2540-49ab-b0ea-33931f530ce4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.302668] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port aadbeef4-bdd4-4778-a717-902878bc8957 with status ACTIVE [ 1005.302668] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.302668] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.302668] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.302668] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.302668] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.302913] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.302913] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.302913] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.303039] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.303083] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.303397] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.303397] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.303503] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.303551] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.303626] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.303706] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: aadbeef4-bdd4-4778-a717-902878bc8957 is going to be updated. [ 1005.327427] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.327628] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.327628] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.327843] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.327971] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.328141] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aadbeef4-bdd4-4778-a717-902878bc8957" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.802792] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7c5e8e45-2540-49ab-b0ea-33931f530ce4',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.305505] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.306195] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.306195] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.306195] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.306195] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.306195] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7c5e8e45-2540-49ab-b0ea-33931f530ce4 is going to be created. [ 1006.342135] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.342353] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.342398] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.342680] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.342870] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.354236] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c5e8e45-2540-49ab-b0ea-33931f530ce4 in Status: UNINITIALIZED for 2s [ 1006.558546] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 934b2684-b99c-4846-87df-66cbae10f2fc in Status: IN_PROGRESS for 50s [ 1006.798110] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d2391c01-2410-4874-a5a8-6da2d957e88c in Status: SUCCESS [ 1006.798453] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2391c01-2410-4874-a5a8-6da2d957e88c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.367532] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c5e8e45-2540-49ab-b0ea-33931f530ce4 in Status: SUCCESS [ 1008.367835] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c5e8e45-2540-49ab-b0ea-33931f530ce4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.368194] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c5e8e45-2540-49ab-b0ea-33931f530ce4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.368427] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c5e8e45-2540-49ab-b0ea-33931f530ce4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.368624] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.368752] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.368792] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.369318] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.369318] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.369318] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c5e8e45-2540-49ab-b0ea-33931f530ce4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.369318] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7c5e8e45-2540-49ab-b0ea-33931f530ce4',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.570367] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 934b2684-b99c-4846-87df-66cbae10f2fc in Status: IN_PROGRESS for 52s [ 1008.872955] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7c5e8e45-2540-49ab-b0ea-33931f530ce4',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.375718] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7c5e8e45-2540-49ab-b0ea-33931f530ce4: rpc.has_security_group_logging(os_id): False [ 1009.394891] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.395062] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.395136] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.395384] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.395460] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.395652] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.395745] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.395804] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.395951] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.396033] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.396624] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7c5e8e45-2540-49ab-b0ea-33931f530ce4 is going to be created. [ 1009.476070] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.476236] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.476310] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.476533] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.476716] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.491799] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7c5e8e45-2540-49ab-b0ea-33931f530ce4 in Status: IN_PROGRESS for 2s [ 1009.794475] env[69232]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1009.794475] env[69232]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1009.909187] env[69232]: INFO networking_nsxv3.common.synchronization [req-168f3f67-94d0-4f55-a6db-2207dac255ff req-6837c3f4-109f-47e9-8ec3-e012be947e1d tempest-ServerActionsTestJSON-973196373 tempest-ServerActionsTestJSON-973196373-project-member] Enqueued Resource ID: adac9a54-9bb6-4368-a762-389898a52bd9 with Priority: HIGHEST for action security_group_members [ 1009.909747] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: adac9a54-9bb6-4368-a762-389898a52bd9 with Priority: HIGHEST for action security_group_members [ 1009.910056] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-adac9a54-9bb6-4368-a762-389898a52bd9 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.910199] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-adac9a54-9bb6-4368-a762-389898a52bd9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.910271] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-adac9a54-9bb6-4368-a762-389898a52bd9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.910517] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-adac9a54-9bb6-4368-a762-389898a52bd9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.910674] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.910763] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.910826] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.910965] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.911425] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.911545] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('adac9a54-9bb6-4368-a762-389898a52bd9',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.374184] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock network-892 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.374548] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "network-892" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.374624] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "network-892" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.374932] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "network-892" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.375306] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.375517] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.375690] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.375968] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.376261] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.376419] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1010.376564] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] NeedRegenerationException {{(pid=69232) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1010.376695] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] no value, waiting for create lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1010.376894] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] value creation lock acquired {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1010.377053] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1010.377135] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Calling creation function for not-yet-present value {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1010.377204] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1010.398161] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1010.398346] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69232) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1010.398486] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Released creation lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1010.398671] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "network-892" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.399107] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock port-7df47ef1-bd2d-4eea-aedb-3d51d2b4fd33 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.399298] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "port-7df47ef1-bd2d-4eea-aedb-3d51d2b4fd33" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.399431] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "port-7df47ef1-bd2d-4eea-aedb-3d51d2b4fd33" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.399761] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "port-7df47ef1-bd2d-4eea-aedb-3d51d2b4fd33" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.399930] env[69232]: DEBUG networking_nsxv3.api.rpc [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7df47ef1-bd2d-4eea-aedb-3d51d2b4fd33',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.414421] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.414600] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.414600] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.415038] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.415038] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.415038] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.415247] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.415247] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.415342] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.415408] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.415969] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: adac9a54-9bb6-4368-a762-389898a52bd9 already deleted. [ 1010.415969] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-adac9a54-9bb6-4368-a762-389898a52bd9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.584840] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 934b2684-b99c-4846-87df-66cbae10f2fc in Status: IN_PROGRESS for 54s [ 1010.902943] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.903367] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.903558] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.904082] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.904360] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.904628] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Segment Port 7df47ef1-bd2d-4eea-aedb-3d51d2b4fd33 not found, creating... [ 1010.905103] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.905387] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.905608] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.905995] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.906256] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.906744] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.907028] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.907258] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.907626] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.907868] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.908128] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Resource: SegmentPort with ID: 7df47ef1-bd2d-4eea-aedb-3d51d2b4fd33 is going to be created. [ 1010.930342] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.930764] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.930842] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.931202] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.931564] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.931868] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "port-7df47ef1-bd2d-4eea-aedb-3d51d2b4fd33" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.506454] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7c5e8e45-2540-49ab-b0ea-33931f530ce4 in Status: SUCCESS [ 1011.506761] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7c5e8e45-2540-49ab-b0ea-33931f530ce4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.961028] env[69232]: INFO networking_nsxv3.common.synchronization [req-168f3f67-94d0-4f55-a6db-2207dac255ff req-16827240-10cd-4e8e-8a30-cd95a2f9fe17 service nova] Enqueued Resource ID: adac9a54-9bb6-4368-a762-389898a52bd9 with Priority: HIGHEST for action security_group_rules [ 1011.961028] env[69232]: INFO networking_nsxv3.common.synchronization [req-168f3f67-94d0-4f55-a6db-2207dac255ff req-16827240-10cd-4e8e-8a30-cd95a2f9fe17 service nova] Enqueued Resource ID: adac9a54-9bb6-4368-a762-389898a52bd9 with Priority: HIGHEST for action security_group_members [ 1011.961028] env[69232]: INFO networking_nsxv3.common.synchronization [req-168f3f67-94d0-4f55-a6db-2207dac255ff req-16827240-10cd-4e8e-8a30-cd95a2f9fe17 service nova] Enqueued Resource ID: 7df47ef1-bd2d-4eea-aedb-3d51d2b4fd33 with Priority: HIGHEST for action port [ 1011.961028] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: adac9a54-9bb6-4368-a762-389898a52bd9 with Priority: HIGHEST for action security_group_rules [ 1011.961028] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: adac9a54-9bb6-4368-a762-389898a52bd9 with Priority: HIGHEST for action security_group_members [ 1011.961028] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7df47ef1-bd2d-4eea-aedb-3d51d2b4fd33 with Priority: HIGHEST for action port [ 1011.961028] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-adac9a54-9bb6-4368-a762-389898a52bd9 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.961028] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-adac9a54-9bb6-4368-a762-389898a52bd9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.961028] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-adac9a54-9bb6-4368-a762-389898a52bd9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.961028] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-adac9a54-9bb6-4368-a762-389898a52bd9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.961028] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('adac9a54-9bb6-4368-a762-389898a52bd9',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.961910] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-adac9a54-9bb6-4368-a762-389898a52bd9 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.962211] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-adac9a54-9bb6-4368-a762-389898a52bd9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.962418] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-adac9a54-9bb6-4368-a762-389898a52bd9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.962731] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-adac9a54-9bb6-4368-a762-389898a52bd9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.963103] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.963374] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.963624] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.963993] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.964274] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.964567] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('adac9a54-9bb6-4368-a762-389898a52bd9',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.966521] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-7df47ef1-bd2d-4eea-aedb-3d51d2b4fd33 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.970236] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7df47ef1-bd2d-4eea-aedb-3d51d2b4fd33" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.970236] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7df47ef1-bd2d-4eea-aedb-3d51d2b4fd33" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.970236] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7df47ef1-bd2d-4eea-aedb-3d51d2b4fd33" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.970236] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7df47ef1-bd2d-4eea-aedb-3d51d2b4fd33',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.470639] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-adac9a54-9bb6-4368-a762-389898a52bd9 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.470639] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-adac9a54-9bb6-4368-a762-389898a52bd9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.470878] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('adac9a54-9bb6-4368-a762-389898a52bd9',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.472019] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7df47ef1-bd2d-4eea-aedb-3d51d2b4fd33 with status ACTIVE [ 1012.472204] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.472438] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.472555] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.472874] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.472962] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.473181] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.473376] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.473446] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.473690] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.473794] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.474019] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.474199] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.474314] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.474509] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.474623] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.474783] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7df47ef1-bd2d-4eea-aedb-3d51d2b4fd33 is going to be updated. [ 1012.498697] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.498914] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.498914] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.499219] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.499439] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.499687] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7df47ef1-bd2d-4eea-aedb-3d51d2b4fd33" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.609188] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 934b2684-b99c-4846-87df-66cbae10f2fc in Status: IN_PROGRESS for 56s [ 1012.977521] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('adac9a54-9bb6-4368-a762-389898a52bd9',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.480095] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.480473] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.480473] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.480811] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.481025] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.481025] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: adac9a54-9bb6-4368-a762-389898a52bd9 is going to be created. [ 1013.515903] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.516351] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.516351] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.516627] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.516710] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.530978] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: adac9a54-9bb6-4368-a762-389898a52bd9 in Status: UNINITIALIZED for 2s [ 1014.623021] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 934b2684-b99c-4846-87df-66cbae10f2fc in Status: IN_PROGRESS for 58s [ 1015.550391] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: adac9a54-9bb6-4368-a762-389898a52bd9 in Status: SUCCESS [ 1015.550675] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-adac9a54-9bb6-4368-a762-389898a52bd9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.550912] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-adac9a54-9bb6-4368-a762-389898a52bd9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.551161] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-adac9a54-9bb6-4368-a762-389898a52bd9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.551410] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.551535] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.551751] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.551885] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.552000] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.552137] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-adac9a54-9bb6-4368-a762-389898a52bd9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.552314] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('adac9a54-9bb6-4368-a762-389898a52bd9',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.055165] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('adac9a54-9bb6-4368-a762-389898a52bd9',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.557590] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for adac9a54-9bb6-4368-a762-389898a52bd9: rpc.has_security_group_logging(os_id): False [ 1016.576565] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.576565] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.576565] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.576890] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.576890] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.577203] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.577473] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.577473] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.577585] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.577666] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.577777] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: adac9a54-9bb6-4368-a762-389898a52bd9 is going to be created. [ 1016.634544] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 934b2684-b99c-4846-87df-66cbae10f2fc in Status: IN_PROGRESS for 60s [ 1016.638662] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.638863] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.638863] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.639103] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.639300] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.652296] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: adac9a54-9bb6-4368-a762-389898a52bd9 in Status: IN_PROGRESS for 2s [ 1016.960560] env[69232]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1016.960758] env[69232]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1018.651240] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 934b2684-b99c-4846-87df-66cbae10f2fc in Status: IN_PROGRESS for 62s [ 1018.663129] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: adac9a54-9bb6-4368-a762-389898a52bd9 in Status: SUCCESS [ 1018.663364] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-adac9a54-9bb6-4368-a762-389898a52bd9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.946299] env[69232]: INFO networking_nsxv3.common.synchronization [req-45e28397-31a7-471b-b378-053eccab3df9 req-6fc9c1fc-a8a8-4e83-8c3f-5b707fe04175 tempest-ServerRescueNegativeTestJSON-737130981 tempest-ServerRescueNegativeTestJSON-737130981-project-member] Enqueued Resource ID: f75b07e5-04f2-4dc3-80ad-ba8105cb4c82 with Priority: HIGHEST for action security_group_members [ 1018.947811] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f75b07e5-04f2-4dc3-80ad-ba8105cb4c82 with Priority: HIGHEST for action security_group_members [ 1018.947811] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-f75b07e5-04f2-4dc3-80ad-ba8105cb4c82 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.947811] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f75b07e5-04f2-4dc3-80ad-ba8105cb4c82" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.947811] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f75b07e5-04f2-4dc3-80ad-ba8105cb4c82" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.947811] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f75b07e5-04f2-4dc3-80ad-ba8105cb4c82" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.947811] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.947811] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.947811] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.948170] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.948170] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.948170] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f75b07e5-04f2-4dc3-80ad-ba8105cb4c82',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.066203] env[69232]: INFO networking_nsxv3.common.synchronization [req-8e63a4ef-3446-4583-a880-04c5b67bf3eb req-e7019a92-c21f-4f64-b46f-81cdc295ffb7 tempest-ServersNegativeTestJSON-459402880 tempest-ServersNegativeTestJSON-459402880-project-member] Enqueued Resource ID: 83d1cdee-a934-490e-9869-707c6882be9d with Priority: HIGHEST for action security_group_members [ 1019.066827] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83d1cdee-a934-490e-9869-707c6882be9d with Priority: HIGHEST for action security_group_members [ 1019.067305] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-83d1cdee-a934-490e-9869-707c6882be9d taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.067453] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-83d1cdee-a934-490e-9869-707c6882be9d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.067523] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-83d1cdee-a934-490e-9869-707c6882be9d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.067726] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-83d1cdee-a934-490e-9869-707c6882be9d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.067885] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.067982] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.068058] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.068207] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.068296] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.068395] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('83d1cdee-a934-490e-9869-707c6882be9d',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.451749] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f75b07e5-04f2-4dc3-80ad-ba8105cb4c82',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.570766] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('83d1cdee-a934-490e-9869-707c6882be9d',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.611022] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock network-934 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.611022] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "network-934" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.611022] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "network-934" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.611022] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "network-934" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.611022] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.611022] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.611022] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.611465] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.611593] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.611925] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1019.611989] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] NeedRegenerationException {{(pid=69232) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1019.612405] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] no value, waiting for create lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1019.612593] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] value creation lock acquired {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1019.612725] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1019.612884] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Calling creation function for not-yet-present value {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1019.613090] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1019.634156] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1019.634156] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69232) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1019.634156] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Released creation lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1019.634371] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "network-934" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.634630] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock port-4a4d26f4-d8c9-4000-891c-889333dda9f6 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.634807] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "port-4a4d26f4-d8c9-4000-891c-889333dda9f6" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.634934] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "port-4a4d26f4-d8c9-4000-891c-889333dda9f6" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.635342] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "port-4a4d26f4-d8c9-4000-891c-889333dda9f6" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.635496] env[69232]: DEBUG networking_nsxv3.api.rpc [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4a4d26f4-d8c9-4000-891c-889333dda9f6',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.956208] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f75b07e5-04f2-4dc3-80ad-ba8105cb4c82',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.073606] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('83d1cdee-a934-490e-9869-707c6882be9d',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.138073] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.138226] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.138353] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.138639] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.139802] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.139802] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Segment Port 4a4d26f4-d8c9-4000-891c-889333dda9f6 not found, creating... [ 1020.139802] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.139802] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.139802] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.139802] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.140159] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.140159] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.140373] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.140498] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.140727] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.140869] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.141024] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Resource: SegmentPort with ID: 4a4d26f4-d8c9-4000-891c-889333dda9f6 is going to be created. [ 1020.161414] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.161414] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.161414] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.161414] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.161414] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.161728] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "port-4a4d26f4-d8c9-4000-891c-889333dda9f6" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.457925] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.457925] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.457925] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.458295] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.458295] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.458476] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f75b07e5-04f2-4dc3-80ad-ba8105cb4c82 is going to be updated. [ 1020.494021] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.494258] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.494258] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.494474] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.494694] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.503789] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f75b07e5-04f2-4dc3-80ad-ba8105cb4c82 in Status: IN_PROGRESS for 2s [ 1020.576277] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.576446] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.576506] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.576724] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.576816] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.576972] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 83d1cdee-a934-490e-9869-707c6882be9d is going to be updated. [ 1020.620463] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.620463] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.620463] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.620463] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.620463] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.633018] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 83d1cdee-a934-490e-9869-707c6882be9d in Status: IN_PROGRESS for 2s [ 1020.666025] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 934b2684-b99c-4846-87df-66cbae10f2fc in Status: IN_PROGRESS for 64s [ 1021.068541] env[69232]: INFO networking_nsxv3.common.synchronization [req-8e63a4ef-3446-4583-a880-04c5b67bf3eb req-36debd79-4395-42e7-ae49-5e0b7c897677 service nova] Enqueued Resource ID: 83d1cdee-a934-490e-9869-707c6882be9d with Priority: HIGHEST for action security_group_rules [ 1021.068880] env[69232]: INFO networking_nsxv3.common.synchronization [req-8e63a4ef-3446-4583-a880-04c5b67bf3eb req-36debd79-4395-42e7-ae49-5e0b7c897677 service nova] Enqueued Resource ID: 83d1cdee-a934-490e-9869-707c6882be9d with Priority: HIGHEST for action security_group_members [ 1021.068880] env[69232]: INFO networking_nsxv3.common.synchronization [req-8e63a4ef-3446-4583-a880-04c5b67bf3eb req-36debd79-4395-42e7-ae49-5e0b7c897677 service nova] Enqueued Resource ID: 4a4d26f4-d8c9-4000-891c-889333dda9f6 with Priority: HIGHEST for action port [ 1021.069192] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83d1cdee-a934-490e-9869-707c6882be9d with Priority: HIGHEST for action security_group_rules [ 1021.069262] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83d1cdee-a934-490e-9869-707c6882be9d with Priority: HIGHEST for action security_group_members [ 1021.069310] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a4d26f4-d8c9-4000-891c-889333dda9f6 with Priority: HIGHEST for action port [ 1021.070186] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-83d1cdee-a934-490e-9869-707c6882be9d taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.070186] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-83d1cdee-a934-490e-9869-707c6882be9d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.070186] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-83d1cdee-a934-490e-9869-707c6882be9d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.070395] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-83d1cdee-a934-490e-9869-707c6882be9d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.070395] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('83d1cdee-a934-490e-9869-707c6882be9d',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.071347] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-83d1cdee-a934-490e-9869-707c6882be9d taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.071442] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-83d1cdee-a934-490e-9869-707c6882be9d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.071630] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-4a4d26f4-d8c9-4000-891c-889333dda9f6 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.071726] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4a4d26f4-d8c9-4000-891c-889333dda9f6" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.071786] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4a4d26f4-d8c9-4000-891c-889333dda9f6" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.071975] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4a4d26f4-d8c9-4000-891c-889333dda9f6" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.072096] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4a4d26f4-d8c9-4000-891c-889333dda9f6',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.573717] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-83d1cdee-a934-490e-9869-707c6882be9d taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.573886] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-83d1cdee-a934-490e-9869-707c6882be9d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.574068] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4a4d26f4-d8c9-4000-891c-889333dda9f6 with status ACTIVE [ 1021.574238] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.574346] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.574412] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.574632] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.574725] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.574893] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.574985] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.575055] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.575203] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.575278] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.575451] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.575545] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.575602] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.575770] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.575844] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.575945] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4a4d26f4-d8c9-4000-891c-889333dda9f6 is going to be updated. [ 1021.598294] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.598573] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.598573] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.598729] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.598961] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.599145] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4a4d26f4-d8c9-4000-891c-889333dda9f6" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.513998] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f75b07e5-04f2-4dc3-80ad-ba8105cb4c82 in Status: SUCCESS [ 1022.514382] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f75b07e5-04f2-4dc3-80ad-ba8105cb4c82" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.641547] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 83d1cdee-a934-490e-9869-707c6882be9d in Status: SUCCESS [ 1022.641774] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-83d1cdee-a934-490e-9869-707c6882be9d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.641941] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-83d1cdee-a934-490e-9869-707c6882be9d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.642181] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-83d1cdee-a934-490e-9869-707c6882be9d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.642437] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.642648] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.642648] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.643144] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.643144] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.643144] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('83d1cdee-a934-490e-9869-707c6882be9d',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.678829] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 934b2684-b99c-4846-87df-66cbae10f2fc in Status: IN_PROGRESS for 66s [ 1023.145709] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('83d1cdee-a934-490e-9869-707c6882be9d',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.545251] env[69232]: INFO networking_nsxv3.common.synchronization [req-c55cf966-a668-4140-b52d-e21202a17711 req-145bc9d0-ea6c-4875-9f3a-4ab363ab8cad tempest-AttachVolumeNegativeTest-731570695 tempest-AttachVolumeNegativeTest-731570695-project-member] Enqueued Resource ID: 8e5c2d57-e29a-48c5-977d-f19d1fe77c00 with Priority: HIGHEST for action security_group_members [ 1023.545526] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e5c2d57-e29a-48c5-977d-f19d1fe77c00 with Priority: HIGHEST for action security_group_members [ 1023.545733] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-8e5c2d57-e29a-48c5-977d-f19d1fe77c00 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.545837] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8e5c2d57-e29a-48c5-977d-f19d1fe77c00" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.545893] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8e5c2d57-e29a-48c5-977d-f19d1fe77c00" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.546524] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8e5c2d57-e29a-48c5-977d-f19d1fe77c00" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.546524] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.546524] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.546524] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.546864] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.546864] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.546864] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8e5c2d57-e29a-48c5-977d-f19d1fe77c00',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.648494] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('83d1cdee-a934-490e-9869-707c6882be9d',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.050886] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.050886] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.050886] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.050886] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.050886] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.050886] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.050886] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.050886] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.050886] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.050886] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.050886] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8e5c2d57-e29a-48c5-977d-f19d1fe77c00 already deleted. [ 1024.050886] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8e5c2d57-e29a-48c5-977d-f19d1fe77c00" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.150572] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.150725] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.150725] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.150914] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.151001] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.151113] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 83d1cdee-a934-490e-9869-707c6882be9d is going to be updated. [ 1024.186307] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.186570] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.186570] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.187535] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.187535] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.198658] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 83d1cdee-a934-490e-9869-707c6882be9d in Status: IN_PROGRESS for 2s [ 1024.355888] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock network-55 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.356107] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "network-55" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.356238] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "network-55" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.356505] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "network-55" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.356796] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.357224] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.357421] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.357680] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.357840] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.358065] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1024.358230] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] NeedRegenerationException {{(pid=69232) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1024.358410] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] no value, waiting for create lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1024.358689] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] value creation lock acquired {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1024.358895] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1024.359530] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Calling creation function for not-yet-present value {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1024.359530] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1024.377680] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1024.377901] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69232) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1024.378067] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Released creation lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1024.378282] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "network-55" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.378640] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock port-56657dc6-ec68-4533-b819-a73bce5d1599 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.378846] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "port-56657dc6-ec68-4533-b819-a73bce5d1599" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.378976] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "port-56657dc6-ec68-4533-b819-a73bce5d1599" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.379309] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "port-56657dc6-ec68-4533-b819-a73bce5d1599" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.379452] env[69232]: DEBUG networking_nsxv3.api.rpc [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('56657dc6-ec68-4533-b819-a73bce5d1599',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.691242] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 934b2684-b99c-4846-87df-66cbae10f2fc in Status: IN_PROGRESS for 68s [ 1024.881924] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.882241] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.882422] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.882719] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.882878] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.883059] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Segment Port 56657dc6-ec68-4533-b819-a73bce5d1599 not found, creating... [ 1024.883348] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.883513] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.883636] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.883893] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.884048] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.884742] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.884920] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.885154] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.885393] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.885543] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.885694] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Resource: SegmentPort with ID: 56657dc6-ec68-4533-b819-a73bce5d1599 is going to be created. [ 1024.906872] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.907095] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.907229] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.907750] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.908124] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.908299] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "port-56657dc6-ec68-4533-b819-a73bce5d1599" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.082464] env[69232]: INFO networking_nsxv3.common.synchronization [req-c55cf966-a668-4140-b52d-e21202a17711 req-d922de33-67aa-41e0-b7da-9771829abaea service nova] Enqueued Resource ID: 8e5c2d57-e29a-48c5-977d-f19d1fe77c00 with Priority: HIGHEST for action security_group_rules [ 1026.082912] env[69232]: INFO networking_nsxv3.common.synchronization [req-c55cf966-a668-4140-b52d-e21202a17711 req-d922de33-67aa-41e0-b7da-9771829abaea service nova] Enqueued Resource ID: 8e5c2d57-e29a-48c5-977d-f19d1fe77c00 with Priority: HIGHEST for action security_group_members [ 1026.082912] env[69232]: INFO networking_nsxv3.common.synchronization [req-c55cf966-a668-4140-b52d-e21202a17711 req-d922de33-67aa-41e0-b7da-9771829abaea service nova] Enqueued Resource ID: 56657dc6-ec68-4533-b819-a73bce5d1599 with Priority: HIGHEST for action port [ 1026.083312] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e5c2d57-e29a-48c5-977d-f19d1fe77c00 with Priority: HIGHEST for action security_group_rules [ 1026.083450] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e5c2d57-e29a-48c5-977d-f19d1fe77c00 with Priority: HIGHEST for action security_group_members [ 1026.083569] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56657dc6-ec68-4533-b819-a73bce5d1599 with Priority: HIGHEST for action port [ 1026.083863] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8e5c2d57-e29a-48c5-977d-f19d1fe77c00 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.083965] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8e5c2d57-e29a-48c5-977d-f19d1fe77c00" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.084687] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8e5c2d57-e29a-48c5-977d-f19d1fe77c00" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.085359] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8e5c2d57-e29a-48c5-977d-f19d1fe77c00" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.085359] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8e5c2d57-e29a-48c5-977d-f19d1fe77c00',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.085889] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-8e5c2d57-e29a-48c5-977d-f19d1fe77c00 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.086195] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8e5c2d57-e29a-48c5-977d-f19d1fe77c00" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.086303] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8e5c2d57-e29a-48c5-977d-f19d1fe77c00" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.086431] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8e5c2d57-e29a-48c5-977d-f19d1fe77c00" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.086580] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.086665] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.086739] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.086891] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.087066] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.088360] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8e5c2d57-e29a-48c5-977d-f19d1fe77c00',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.092214] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-56657dc6-ec68-4533-b819-a73bce5d1599 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.092328] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-56657dc6-ec68-4533-b819-a73bce5d1599" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.093557] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-56657dc6-ec68-4533-b819-a73bce5d1599" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.093824] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-56657dc6-ec68-4533-b819-a73bce5d1599" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.093913] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('56657dc6-ec68-4533-b819-a73bce5d1599',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.144796] env[69232]: INFO networking_nsxv3.common.synchronization [req-d8cc2425-0734-4bf9-ab4f-a154699ea95b req-4ae3a127-25e5-4136-bcec-ed6a0c866eea tempest-ImagesTestJSON-1245210724 tempest-ImagesTestJSON-1245210724-project-member] Enqueued Resource ID: fb3494b9-4ce5-4744-a378-ecbcd5c2bec9 with Priority: HIGHEST for action security_group_members [ 1026.145987] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb3494b9-4ce5-4744-a378-ecbcd5c2bec9 with Priority: HIGHEST for action security_group_members [ 1026.149316] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.149972] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.150273] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.150612] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.150947] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.151639] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.151784] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.152119] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.152307] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.152556] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fb3494b9-4ce5-4744-a378-ecbcd5c2bec9',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.219634] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 83d1cdee-a934-490e-9869-707c6882be9d in Status: SUCCESS [ 1026.219949] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-83d1cdee-a934-490e-9869-707c6882be9d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.220603] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-83d1cdee-a934-490e-9869-707c6882be9d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.220819] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-83d1cdee-a934-490e-9869-707c6882be9d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.221021] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.221134] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.221197] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.221355] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.221433] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.221515] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-83d1cdee-a934-490e-9869-707c6882be9d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.221709] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('83d1cdee-a934-490e-9869-707c6882be9d',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.224539] env[69232]: INFO networking_nsxv3.common.synchronization [req-765d18ac-7471-491a-9b75-b728a32ca630 req-e2bce1ea-fae7-4cc1-aded-a02ff8ff852b tempest-ListServerFiltersTestJSON-193943041 tempest-ListServerFiltersTestJSON-193943041-project-member] Enqueued Resource ID: 8f8cfd9d-acc3-4fa8-825d-c583365a30ed with Priority: HIGHEST for action security_group_members [ 1026.225588] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f8cfd9d-acc3-4fa8-825d-c583365a30ed with Priority: HIGHEST for action security_group_members [ 1026.225847] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f8cfd9d-acc3-4fa8-825d-c583365a30ed taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.225986] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f8cfd9d-acc3-4fa8-825d-c583365a30ed" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.226130] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f8cfd9d-acc3-4fa8-825d-c583365a30ed" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.226255] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f8cfd9d-acc3-4fa8-825d-c583365a30ed" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.226407] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.226786] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.226786] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.226786] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.226786] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.226985] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8f8cfd9d-acc3-4fa8-825d-c583365a30ed',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.254747] env[69232]: INFO networking_nsxv3.common.synchronization [req-8cd1ed7e-0612-4ac1-a49f-a1c991063cad req-ac7cf5e2-16cf-44c2-9a7d-079ece279eb8 tempest-AttachVolumeShelveTestJSON-303748050 tempest-AttachVolumeShelveTestJSON-303748050-project-member] Enqueued Resource ID: 9ea0b8f1-7dc8-48fd-bd49-a3ae8c7a9645 with Priority: HIGHEST for action security_group_members [ 1026.255421] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ea0b8f1-7dc8-48fd-bd49-a3ae8c7a9645 with Priority: HIGHEST for action security_group_members [ 1026.255734] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ea0b8f1-7dc8-48fd-bd49-a3ae8c7a9645 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.255861] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ea0b8f1-7dc8-48fd-bd49-a3ae8c7a9645" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.255929] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ea0b8f1-7dc8-48fd-bd49-a3ae8c7a9645" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.256916] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ea0b8f1-7dc8-48fd-bd49-a3ae8c7a9645" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.257385] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.257385] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.257536] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.257862] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.257862] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.258228] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9ea0b8f1-7dc8-48fd-bd49-a3ae8c7a9645',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.592520] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8e5c2d57-e29a-48c5-977d-f19d1fe77c00',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.595881] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-8e5c2d57-e29a-48c5-977d-f19d1fe77c00 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.595998] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8e5c2d57-e29a-48c5-977d-f19d1fe77c00" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.596794] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 56657dc6-ec68-4533-b819-a73bce5d1599 with status ACTIVE [ 1026.597858] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.597858] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.597858] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.597858] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.597858] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.597858] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.597858] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.597858] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.598195] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.598195] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.598283] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.602020] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.602020] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.602020] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.602020] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.602020] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 56657dc6-ec68-4533-b819-a73bce5d1599 is going to be updated. [ 1026.623579] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.623666] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.623736] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.623945] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.625044] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.625358] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-56657dc6-ec68-4533-b819-a73bce5d1599" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.638039] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock network-674 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.638246] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "network-674" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.638380] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "network-674" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.638663] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "network-674" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.638925] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.639884] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.639884] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.639884] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.639884] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.639884] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1026.640116] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] NeedRegenerationException {{(pid=69232) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1026.640116] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] no value, waiting for create lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1026.640184] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] value creation lock acquired {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1026.640272] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1026.640373] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Calling creation function for not-yet-present value {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1026.640524] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1026.658317] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.658413] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.658453] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.658664] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.658777] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.659082] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.659209] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.659282] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.659466] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.659537] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.659636] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb3494b9-4ce5-4744-a378-ecbcd5c2bec9 is going to be updated. [ 1026.662868] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1026.662868] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69232) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1026.662868] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Released creation lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1026.662868] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "network-674" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.663120] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock port-771870f3-5e3c-4d9f-a5b2-aa3f285140df taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.663120] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "port-771870f3-5e3c-4d9f-a5b2-aa3f285140df" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.663237] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "port-771870f3-5e3c-4d9f-a5b2-aa3f285140df" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.664974] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "port-771870f3-5e3c-4d9f-a5b2-aa3f285140df" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.664974] env[69232]: DEBUG networking_nsxv3.api.rpc [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('771870f3-5e3c-4d9f-a5b2-aa3f285140df',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.701792] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.702208] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.702406] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.702712] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.702974] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.705530] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 934b2684-b99c-4846-87df-66cbae10f2fc in Status: IN_PROGRESS for 70s [ 1026.713252] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb3494b9-4ce5-4744-a378-ecbcd5c2bec9 in Status: IN_PROGRESS for 2s [ 1026.725451] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-83d1cdee-a934-490e-9869-707c6882be9d taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.725609] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-83d1cdee-a934-490e-9869-707c6882be9d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.725712] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-83d1cdee-a934-490e-9869-707c6882be9d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.725891] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-83d1cdee-a934-490e-9869-707c6882be9d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.726069] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.726224] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.726224] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.726370] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.726460] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.726546] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-83d1cdee-a934-490e-9869-707c6882be9d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.726721] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-83d1cdee-a934-490e-9869-707c6882be9d taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.726833] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-83d1cdee-a934-490e-9869-707c6882be9d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.726899] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-83d1cdee-a934-490e-9869-707c6882be9d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.727058] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-83d1cdee-a934-490e-9869-707c6882be9d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.727196] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.727284] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.727343] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.727478] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.727553] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.727633] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-83d1cdee-a934-490e-9869-707c6882be9d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.727720] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('83d1cdee-a934-490e-9869-707c6882be9d',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.729744] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.729892] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.729963] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.730137] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.730223] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.730463] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.730566] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.730628] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.730771] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.730846] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.730961] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8f8cfd9d-acc3-4fa8-825d-c583365a30ed is going to be updated. [ 1026.762929] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.763144] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.763144] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.763401] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.763550] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.764920] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.765104] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.765211] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.765440] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.765536] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.765728] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.765827] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.765889] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.766065] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.766148] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.766328] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9ea0b8f1-7dc8-48fd-bd49-a3ae8c7a9645 is going to be updated. [ 1026.784981] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f8cfd9d-acc3-4fa8-825d-c583365a30ed in Status: IN_PROGRESS for 2s [ 1026.810706] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.810950] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.811028] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.811330] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.811474] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.823619] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ea0b8f1-7dc8-48fd-bd49-a3ae8c7a9645 in Status: IN_PROGRESS for 2s [ 1027.097800] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8e5c2d57-e29a-48c5-977d-f19d1fe77c00',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.167282] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.167647] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.167839] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.168174] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.168387] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.168619] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Segment Port 771870f3-5e3c-4d9f-a5b2-aa3f285140df not found, creating... [ 1027.169045] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.169253] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.169424] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.169872] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.170098] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.170541] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.170815] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.171204] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.171495] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.171495] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.171673] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Resource: SegmentPort with ID: 771870f3-5e3c-4d9f-a5b2-aa3f285140df is going to be created. [ 1027.208953] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.210290] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.210290] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.210290] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.210290] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.210290] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "port-771870f3-5e3c-4d9f-a5b2-aa3f285140df" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.230885] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 83d1cdee-a934-490e-9869-707c6882be9d: rpc.has_security_group_logging(os_id): False [ 1027.246224] env[69232]: INFO networking_nsxv3.common.synchronization [req-8e08f26c-f524-4033-9932-d88037e80783 req-a1d0395c-7f44-48a1-ab9b-15ebe2252972 tempest-ServerActionsTestOtherA-781098598 tempest-ServerActionsTestOtherA-781098598-project-member] Enqueued Resource ID: e18d5d2b-f965-404d-b211-f58621ceccf1 with Priority: HIGHEST for action security_group_members [ 1027.246745] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e18d5d2b-f965-404d-b211-f58621ceccf1 with Priority: HIGHEST for action security_group_members [ 1027.247076] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-e18d5d2b-f965-404d-b211-f58621ceccf1 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.247859] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e18d5d2b-f965-404d-b211-f58621ceccf1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.247859] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e18d5d2b-f965-404d-b211-f58621ceccf1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.247859] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e18d5d2b-f965-404d-b211-f58621ceccf1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.247859] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.247859] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.247859] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.248158] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.248158] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.248158] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e18d5d2b-f965-404d-b211-f58621ceccf1',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.251122] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.251122] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.251122] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.251122] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.251122] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.251122] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.251122] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.251122] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.251122] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.251122] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.251545] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.251545] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.251545] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.251810] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.251810] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.252244] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.252244] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.252244] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.252244] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.252677] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.252677] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 83d1cdee-a934-490e-9869-707c6882be9d is going to be updated. [ 1027.342924] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.343170] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.343170] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.344868] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.344868] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.369130] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 83d1cdee-a934-490e-9869-707c6882be9d in Status: IN_PROGRESS for 2s [ 1027.604708] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.604920] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.604984] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.605225] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.605295] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.605400] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8e5c2d57-e29a-48c5-977d-f19d1fe77c00 is going to be created. [ 1027.633823] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.634030] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.634140] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.634385] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.634584] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.651473] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8e5c2d57-e29a-48c5-977d-f19d1fe77c00 in Status: UNINITIALIZED for 2s [ 1027.754955] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.755042] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.755083] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.755277] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.755366] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.755566] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.755663] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.755719] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.755866] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.755943] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.756074] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e18d5d2b-f965-404d-b211-f58621ceccf1 is going to be updated. [ 1027.793063] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.793264] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.793341] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.793792] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.793948] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.805540] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e18d5d2b-f965-404d-b211-f58621ceccf1 in Status: IN_PROGRESS for 2s [ 1027.893678] env[69232]: INFO networking_nsxv3.common.synchronization [req-d8cc2425-0734-4bf9-ab4f-a154699ea95b req-b51ddd6a-1ec5-479b-9b4c-0d4842a064a9 service nova] Enqueued Resource ID: fb3494b9-4ce5-4744-a378-ecbcd5c2bec9 with Priority: HIGHEST for action security_group_rules [ 1027.893678] env[69232]: INFO networking_nsxv3.common.synchronization [req-d8cc2425-0734-4bf9-ab4f-a154699ea95b req-b51ddd6a-1ec5-479b-9b4c-0d4842a064a9 service nova] Enqueued Resource ID: fb3494b9-4ce5-4744-a378-ecbcd5c2bec9 with Priority: HIGHEST for action security_group_members [ 1027.893678] env[69232]: INFO networking_nsxv3.common.synchronization [req-d8cc2425-0734-4bf9-ab4f-a154699ea95b req-b51ddd6a-1ec5-479b-9b4c-0d4842a064a9 service nova] Enqueued Resource ID: 771870f3-5e3c-4d9f-a5b2-aa3f285140df with Priority: HIGHEST for action port [ 1027.893981] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb3494b9-4ce5-4744-a378-ecbcd5c2bec9 with Priority: HIGHEST for action security_group_rules [ 1027.894068] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb3494b9-4ce5-4744-a378-ecbcd5c2bec9 with Priority: HIGHEST for action security_group_members [ 1027.894151] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 771870f3-5e3c-4d9f-a5b2-aa3f285140df with Priority: HIGHEST for action port [ 1027.894414] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.894545] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.894610] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.895064] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.895064] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fb3494b9-4ce5-4744-a378-ecbcd5c2bec9',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.896740] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.896740] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.896740] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-771870f3-5e3c-4d9f-a5b2-aa3f285140df taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.896740] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-771870f3-5e3c-4d9f-a5b2-aa3f285140df" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.896740] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-771870f3-5e3c-4d9f-a5b2-aa3f285140df" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.896740] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-771870f3-5e3c-4d9f-a5b2-aa3f285140df" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.897072] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('771870f3-5e3c-4d9f-a5b2-aa3f285140df',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.398775] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.398775] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.403263] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 771870f3-5e3c-4d9f-a5b2-aa3f285140df with status ACTIVE [ 1028.403263] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.403263] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.403263] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.403263] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.403567] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.403837] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.403976] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.404071] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.405197] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.405197] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.405197] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.405197] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.405197] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.405197] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.405469] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.405469] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 771870f3-5e3c-4d9f-a5b2-aa3f285140df is going to be updated. [ 1028.430186] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.430426] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.430487] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.430854] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.431059] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.431277] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-771870f3-5e3c-4d9f-a5b2-aa3f285140df" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.679199] env[69232]: INFO networking_nsxv3.common.synchronization [req-47199714-19c8-41a7-b9f0-83821d58d45e req-a833759c-af72-4d9f-a0d2-c1eff8714110 tempest-MultipleCreateTestJSON-2129230941 tempest-MultipleCreateTestJSON-2129230941-project-member] Enqueued Resource ID: be581393-4638-4971-8e7f-56047ad132ae with Priority: HIGHEST for action security_group_members [ 1028.679199] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: be581393-4638-4971-8e7f-56047ad132ae with Priority: HIGHEST for action security_group_members [ 1028.679199] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-be581393-4638-4971-8e7f-56047ad132ae taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.679199] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-be581393-4638-4971-8e7f-56047ad132ae" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.679199] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-be581393-4638-4971-8e7f-56047ad132ae" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.679199] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-be581393-4638-4971-8e7f-56047ad132ae" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.680157] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.680524] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.680748] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.681094] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.681477] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.681735] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('be581393-4638-4971-8e7f-56047ad132ae',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.726611] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 934b2684-b99c-4846-87df-66cbae10f2fc in Status: IN_PROGRESS for 72s [ 1028.729253] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb3494b9-4ce5-4744-a378-ecbcd5c2bec9 in Status: SUCCESS [ 1028.729253] env[69232]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb3494b9-4ce5-4744-a378-ecbcd5c2bec9 deletion is rescheduled due to dependency. [ 1028.729253] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.729253] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.729253] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.729253] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.729253] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.730358] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.730606] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.730712] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.730882] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fb3494b9-4ce5-4744-a378-ecbcd5c2bec9',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.796806] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f8cfd9d-acc3-4fa8-825d-c583365a30ed in Status: SUCCESS [ 1028.797074] env[69232]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8f8cfd9d-acc3-4fa8-825d-c583365a30ed deletion is rescheduled due to dependency. [ 1028.797157] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f8cfd9d-acc3-4fa8-825d-c583365a30ed" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.836869] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ea0b8f1-7dc8-48fd-bd49-a3ae8c7a9645 in Status: SUCCESS [ 1028.837113] env[69232]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9ea0b8f1-7dc8-48fd-bd49-a3ae8c7a9645 deletion is rescheduled due to dependency. [ 1028.837235] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ea0b8f1-7dc8-48fd-bd49-a3ae8c7a9645" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.160826] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock network-644 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.161054] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "network-644" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.161191] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "network-644" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.161542] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "network-644" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.161815] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.161976] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.162116] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.162351] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.162534] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.162961] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1029.163106] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] NeedRegenerationException {{(pid=69232) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1029.163224] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] no value, waiting for create lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1029.163341] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] value creation lock acquired {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1029.163468] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1029.163587] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Calling creation function for not-yet-present value {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1029.163728] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1029.184067] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.184219] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.184289] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.184516] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.184606] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.184875] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.184997] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.185099] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.185286] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.185361] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.185464] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: be581393-4638-4971-8e7f-56047ad132ae already deleted. [ 1029.185535] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-be581393-4638-4971-8e7f-56047ad132ae" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.203128] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1029.203128] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Cache value generated in 0.038 seconds for key(s): 'zone-id' {{(pid=69232) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1029.203128] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Released creation lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1029.203128] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "network-644" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.203128] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock port-8277996f-7f76-4d82-b8b5-2a4b681edfea taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.203128] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "port-8277996f-7f76-4d82-b8b5-2a4b681edfea" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.203128] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "port-8277996f-7f76-4d82-b8b5-2a4b681edfea" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.203128] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "port-8277996f-7f76-4d82-b8b5-2a4b681edfea" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.204021] env[69232]: DEBUG networking_nsxv3.api.rpc [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8277996f-7f76-4d82-b8b5-2a4b681edfea',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.232898] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fb3494b9-4ce5-4744-a378-ecbcd5c2bec9',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.387469] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 83d1cdee-a934-490e-9869-707c6882be9d in Status: SUCCESS [ 1029.387718] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-83d1cdee-a934-490e-9869-707c6882be9d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.661477] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8e5c2d57-e29a-48c5-977d-f19d1fe77c00 in Status: SUCCESS [ 1029.661869] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8e5c2d57-e29a-48c5-977d-f19d1fe77c00" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.661991] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8e5c2d57-e29a-48c5-977d-f19d1fe77c00" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.662226] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8e5c2d57-e29a-48c5-977d-f19d1fe77c00" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.662453] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.662578] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.662660] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.662822] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.662934] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.663096] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8e5c2d57-e29a-48c5-977d-f19d1fe77c00" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.663194] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8e5c2d57-e29a-48c5-977d-f19d1fe77c00',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.709145] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.709355] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.709461] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.709743] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.709905] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.710169] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Segment Port 8277996f-7f76-4d82-b8b5-2a4b681edfea not found, creating... [ 1029.710525] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.710721] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.710876] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.711141] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.711293] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.711698] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.711893] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.712135] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.712425] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.712566] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.712723] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Resource: SegmentPort with ID: 8277996f-7f76-4d82-b8b5-2a4b681edfea is going to be created. [ 1029.732727] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.733067] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.733211] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.733493] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.733782] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.734172] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "port-8277996f-7f76-4d82-b8b5-2a4b681edfea" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.735090] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fb3494b9-4ce5-4744-a378-ecbcd5c2bec9',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.815937] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e18d5d2b-f965-404d-b211-f58621ceccf1 in Status: SUCCESS [ 1029.816136] env[69232]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e18d5d2b-f965-404d-b211-f58621ceccf1 deletion is rescheduled due to dependency. [ 1029.816315] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e18d5d2b-f965-404d-b211-f58621ceccf1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.167136] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8e5c2d57-e29a-48c5-977d-f19d1fe77c00',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.237314] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.237490] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.237596] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.237845] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.237962] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.238266] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb3494b9-4ce5-4744-a378-ecbcd5c2bec9 is going to be updated. [ 1030.268682] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.268869] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.268966] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.269237] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.269392] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.279423] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb3494b9-4ce5-4744-a378-ecbcd5c2bec9 in Status: IN_PROGRESS for 2s [ 1030.461220] env[69232]: INFO networking_nsxv3.common.synchronization [req-47199714-19c8-41a7-b9f0-83821d58d45e req-bc6cdd8b-37fb-4e8f-881d-5b3204f1a0f0 service nova] Enqueued Resource ID: be581393-4638-4971-8e7f-56047ad132ae with Priority: HIGHEST for action security_group_rules [ 1030.461498] env[69232]: INFO networking_nsxv3.common.synchronization [req-47199714-19c8-41a7-b9f0-83821d58d45e req-bc6cdd8b-37fb-4e8f-881d-5b3204f1a0f0 service nova] Enqueued Resource ID: be581393-4638-4971-8e7f-56047ad132ae with Priority: HIGHEST for action security_group_members [ 1030.461644] env[69232]: INFO networking_nsxv3.common.synchronization [req-47199714-19c8-41a7-b9f0-83821d58d45e req-bc6cdd8b-37fb-4e8f-881d-5b3204f1a0f0 service nova] Enqueued Resource ID: 8277996f-7f76-4d82-b8b5-2a4b681edfea with Priority: HIGHEST for action port [ 1030.462229] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: be581393-4638-4971-8e7f-56047ad132ae with Priority: HIGHEST for action security_group_rules [ 1030.462359] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: be581393-4638-4971-8e7f-56047ad132ae with Priority: HIGHEST for action security_group_members [ 1030.462532] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8277996f-7f76-4d82-b8b5-2a4b681edfea with Priority: HIGHEST for action port [ 1030.462754] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-be581393-4638-4971-8e7f-56047ad132ae taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.462877] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-be581393-4638-4971-8e7f-56047ad132ae" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.462959] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-be581393-4638-4971-8e7f-56047ad132ae" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.463352] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-be581393-4638-4971-8e7f-56047ad132ae" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.463352] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('be581393-4638-4971-8e7f-56047ad132ae',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.464255] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-be581393-4638-4971-8e7f-56047ad132ae taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.464361] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-be581393-4638-4971-8e7f-56047ad132ae" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.464412] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-be581393-4638-4971-8e7f-56047ad132ae" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.464649] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-be581393-4638-4971-8e7f-56047ad132ae" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.464840] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.464840] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.465510] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.465510] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.465510] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.465510] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('be581393-4638-4971-8e7f-56047ad132ae',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.466837] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-8277996f-7f76-4d82-b8b5-2a4b681edfea taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.466932] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8277996f-7f76-4d82-b8b5-2a4b681edfea" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.466993] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8277996f-7f76-4d82-b8b5-2a4b681edfea" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.467980] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8277996f-7f76-4d82-b8b5-2a4b681edfea" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.467980] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8277996f-7f76-4d82-b8b5-2a4b681edfea',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.639235] env[69232]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-94066da2-e1f6-4276-9635-375c603f4834 None None] NSXv3 Agent Agent loop - iteration:1 completed [ 1030.639235] env[69232]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-94066da2-e1f6-4276-9635-375c603f4834 None None] NSXv3 Agent Agent loop - iteration:2 started [ 1030.669415] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8e5c2d57-e29a-48c5-977d-f19d1fe77c00: rpc.has_security_group_logging(os_id): False [ 1030.689495] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.689669] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.689718] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.690913] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.690913] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.690913] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.690913] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.690913] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.690913] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.691152] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.691152] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8e5c2d57-e29a-48c5-977d-f19d1fe77c00 is going to be created. [ 1030.740750] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 934b2684-b99c-4846-87df-66cbae10f2fc in Status: IN_PROGRESS for 74s [ 1030.778615] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.778887] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.779061] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.779139] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.779315] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.792915] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8e5c2d57-e29a-48c5-977d-f19d1fe77c00 in Status: IN_PROGRESS for 2s [ 1030.969696] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('be581393-4638-4971-8e7f-56047ad132ae',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.970898] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-be581393-4638-4971-8e7f-56047ad132ae taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.971145] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-be581393-4638-4971-8e7f-56047ad132ae" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.971427] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8277996f-7f76-4d82-b8b5-2a4b681edfea with status ACTIVE [ 1030.971589] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.971694] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.971766] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.971956] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.972101] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.972299] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.972438] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.972501] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.972728] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.972820] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.973043] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.973103] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.973173] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.973317] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.973396] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.973480] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8277996f-7f76-4d82-b8b5-2a4b681edfea is going to be updated. [ 1030.996040] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.996247] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.996306] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.996523] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.996658] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.996818] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8277996f-7f76-4d82-b8b5-2a4b681edfea" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.472301] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('be581393-4638-4971-8e7f-56047ad132ae',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.975729] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.975729] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.975729] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.976109] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.976109] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.976109] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: be581393-4638-4971-8e7f-56047ad132ae is going to be created. [ 1032.001592] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.001817] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.001817] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.002059] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.002234] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.025520] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: be581393-4638-4971-8e7f-56047ad132ae in Status: UNINITIALIZED for 2s [ 1032.291523] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb3494b9-4ce5-4744-a378-ecbcd5c2bec9 in Status: SUCCESS [ 1032.291802] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.292089] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.292218] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.292387] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.292568] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.292643] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.293141] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.293141] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.293141] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.293141] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fb3494b9-4ce5-4744-a378-ecbcd5c2bec9',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.678147] env[69232]: INFO networking_nsxv3.common.synchronization [req-47199714-19c8-41a7-b9f0-83821d58d45e req-9b1ea5da-8a20-440d-b4c6-6a747b49ced7 tempest-MultipleCreateTestJSON-2129230941 tempest-MultipleCreateTestJSON-2129230941-project-member] Enqueued Resource ID: be581393-4638-4971-8e7f-56047ad132ae with Priority: HIGHEST for action security_group_members [ 1032.681274] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: be581393-4638-4971-8e7f-56047ad132ae with Priority: HIGHEST for action security_group_members [ 1032.681274] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-be581393-4638-4971-8e7f-56047ad132ae taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.681274] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-be581393-4638-4971-8e7f-56047ad132ae" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.755535] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 934b2684-b99c-4846-87df-66cbae10f2fc in Status: IN_PROGRESS for 76s [ 1032.795195] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.795359] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.795415] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.795651] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.795820] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.795964] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.796017] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.796141] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.796327] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.796327] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.796525] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.796590] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.796590] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.796721] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.796848] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.796931] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.796986] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.797251] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.797347] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.797441] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.797545] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fb3494b9-4ce5-4744-a378-ecbcd5c2bec9',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.808221] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8e5c2d57-e29a-48c5-977d-f19d1fe77c00 in Status: SUCCESS [ 1032.808499] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8e5c2d57-e29a-48c5-977d-f19d1fe77c00" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.979325] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock network-644 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.979325] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "network-644" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.979325] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "network-644" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.979325] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "network-644" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.979325] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.979325] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.979856] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.980167] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.980341] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.980631] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1032.980770] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] NeedRegenerationException {{(pid=69232) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1032.980889] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] no value, waiting for create lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1032.981018] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] value creation lock acquired {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1032.981146] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1032.981261] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Calling creation function for not-yet-present value {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1032.981404] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1033.001476] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1033.002333] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69232) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1033.002333] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Released creation lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1033.002333] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "network-644" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.002333] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock port-3c4b1436-f588-411d-af84-e56111846f4a taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.002647] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "port-3c4b1436-f588-411d-af84-e56111846f4a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.002686] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "port-3c4b1436-f588-411d-af84-e56111846f4a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.003051] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "port-3c4b1436-f588-411d-af84-e56111846f4a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.003252] env[69232]: DEBUG networking_nsxv3.api.rpc [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3c4b1436-f588-411d-af84-e56111846f4a',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.300230] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fb3494b9-4ce5-4744-a378-ecbcd5c2bec9: rpc.has_security_group_logging(os_id): False [ 1033.318657] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.318893] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.319016] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.319756] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.319756] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.319756] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.319756] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.319756] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.320021] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.320021] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.320266] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.320395] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.320465] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.320634] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.320712] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.320909] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.321036] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.321101] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.321240] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.321314] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.321399] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fb3494b9-4ce5-4744-a378-ecbcd5c2bec9 is going to be updated. [ 1033.386918] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.387128] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.387277] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.387553] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.387745] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.403758] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fb3494b9-4ce5-4744-a378-ecbcd5c2bec9 in Status: IN_PROGRESS for 2s [ 1033.505707] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.506086] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.506264] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.506597] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.506830] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.507088] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Segment Port 3c4b1436-f588-411d-af84-e56111846f4a not found, creating... [ 1033.507446] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.507672] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.507839] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.508206] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.508405] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.508898] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.509175] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.509513] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.509661] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.509852] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.510076] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Resource: SegmentPort with ID: 3c4b1436-f588-411d-af84-e56111846f4a is going to be created. [ 1033.532488] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.532666] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.532946] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.533174] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.533469] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.533811] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "port-3c4b1436-f588-411d-af84-e56111846f4a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.039593] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: be581393-4638-4971-8e7f-56047ad132ae in Status: SUCCESS [ 1034.039593] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-be581393-4638-4971-8e7f-56047ad132ae" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.039593] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-be581393-4638-4971-8e7f-56047ad132ae" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.039593] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-be581393-4638-4971-8e7f-56047ad132ae" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.039593] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.039593] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.039593] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.039593] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.039593] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.039593] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-be581393-4638-4971-8e7f-56047ad132ae" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.039593] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('be581393-4638-4971-8e7f-56047ad132ae',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.046949] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-be581393-4638-4971-8e7f-56047ad132ae" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.046949] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-be581393-4638-4971-8e7f-56047ad132ae" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.046949] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.046949] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.046949] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.046949] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.046949] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.046949] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('be581393-4638-4971-8e7f-56047ad132ae',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.254392] env[69232]: INFO networking_nsxv3.common.synchronization [req-57608f17-8ff3-4ca5-af2c-ade86c321846 req-3c558eb3-e9ba-4b92-9b98-76cc54bc597e tempest-ServersNegativeTestJSON-459402880 tempest-ServersNegativeTestJSON-459402880-project-member] Enqueued Resource ID: 83d1cdee-a934-490e-9869-707c6882be9d with Priority: HIGHEST for action security_group_members [ 1034.254392] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83d1cdee-a934-490e-9869-707c6882be9d with Priority: HIGHEST for action security_group_members [ 1034.254392] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-83d1cdee-a934-490e-9869-707c6882be9d taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.254392] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-83d1cdee-a934-490e-9869-707c6882be9d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.254392] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-83d1cdee-a934-490e-9869-707c6882be9d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.254392] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-83d1cdee-a934-490e-9869-707c6882be9d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.254392] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.254392] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.254392] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.254392] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.254392] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.254392] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('83d1cdee-a934-490e-9869-707c6882be9d',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.390056] env[69232]: INFO networking_nsxv3.common.synchronization [req-47199714-19c8-41a7-b9f0-83821d58d45e req-752a6200-6b00-42a7-a242-3b53dd9fcf1b service nova] Enqueued Resource ID: be581393-4638-4971-8e7f-56047ad132ae with Priority: HIGHEST for action security_group_rules [ 1034.390056] env[69232]: INFO networking_nsxv3.common.synchronization [req-47199714-19c8-41a7-b9f0-83821d58d45e req-752a6200-6b00-42a7-a242-3b53dd9fcf1b service nova] Enqueued Resource ID: be581393-4638-4971-8e7f-56047ad132ae with Priority: HIGHEST for action security_group_members [ 1034.390215] env[69232]: INFO networking_nsxv3.common.synchronization [req-47199714-19c8-41a7-b9f0-83821d58d45e req-752a6200-6b00-42a7-a242-3b53dd9fcf1b service nova] Enqueued Resource ID: 3c4b1436-f588-411d-af84-e56111846f4a with Priority: HIGHEST for action port [ 1034.390884] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: be581393-4638-4971-8e7f-56047ad132ae with Priority: HIGHEST for action security_group_rules [ 1034.391630] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: be581393-4638-4971-8e7f-56047ad132ae with Priority: HIGHEST for action security_group_members [ 1034.391782] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c4b1436-f588-411d-af84-e56111846f4a with Priority: HIGHEST for action port [ 1034.392308] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-be581393-4638-4971-8e7f-56047ad132ae taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.392388] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-be581393-4638-4971-8e7f-56047ad132ae" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.392708] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-be581393-4638-4971-8e7f-56047ad132ae taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.392925] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-be581393-4638-4971-8e7f-56047ad132ae" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.393280] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-3c4b1436-f588-411d-af84-e56111846f4a taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.393280] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3c4b1436-f588-411d-af84-e56111846f4a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.393655] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3c4b1436-f588-411d-af84-e56111846f4a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.393655] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3c4b1436-f588-411d-af84-e56111846f4a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.393740] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3c4b1436-f588-411d-af84-e56111846f4a',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.545382] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-be581393-4638-4971-8e7f-56047ad132ae taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.545563] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-be581393-4638-4971-8e7f-56047ad132ae" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.550016] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('be581393-4638-4971-8e7f-56047ad132ae',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.761227] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('83d1cdee-a934-490e-9869-707c6882be9d',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.774418] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 934b2684-b99c-4846-87df-66cbae10f2fc in Status: SUCCESS [ 1034.774681] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-934b2684-b99c-4846-87df-66cbae10f2fc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.898147] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3c4b1436-f588-411d-af84-e56111846f4a with status ACTIVE [ 1034.899052] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.899052] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.899052] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.899052] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.899052] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.899512] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.899512] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.899512] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.900764] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.900901] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.901108] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.901213] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.901277] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.901434] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.901514] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.901605] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3c4b1436-f588-411d-af84-e56111846f4a is going to be updated. [ 1034.922079] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.922267] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.922267] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.922363] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.922527] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.922689] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3c4b1436-f588-411d-af84-e56111846f4a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.052734] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('be581393-4638-4971-8e7f-56047ad132ae',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.263639] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('83d1cdee-a934-490e-9869-707c6882be9d',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.419188] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fb3494b9-4ce5-4744-a378-ecbcd5c2bec9 in Status: SUCCESS [ 1035.419413] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.555854] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.556043] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.556107] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.556343] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.556455] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.556558] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: be581393-4638-4971-8e7f-56047ad132ae is going to be updated. [ 1035.601220] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.601382] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.601451] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.601664] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.601854] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.612027] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: be581393-4638-4971-8e7f-56047ad132ae in Status: IN_PROGRESS for 2s [ 1035.767207] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.767422] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.767527] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.767822] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.767957] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.768116] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 83d1cdee-a934-490e-9869-707c6882be9d is going to be updated. [ 1035.801536] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.801739] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.801840] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.802173] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.802378] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.817737] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 83d1cdee-a934-490e-9869-707c6882be9d in Status: IN_PROGRESS for 2s [ 1037.624033] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: be581393-4638-4971-8e7f-56047ad132ae in Status: SUCCESS [ 1037.624033] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-be581393-4638-4971-8e7f-56047ad132ae" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.624468] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-be581393-4638-4971-8e7f-56047ad132ae" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.624468] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-be581393-4638-4971-8e7f-56047ad132ae" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.624635] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.624755] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.624811] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.624995] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.625087] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.625184] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('be581393-4638-4971-8e7f-56047ad132ae',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.820229] env[69232]: INFO networking_nsxv3.common.synchronization [None req-9777a305-20d7-4b34-9c5e-849eb6762e44 tempest-AttachInterfacesTestJSON-1442903876 tempest-AttachInterfacesTestJSON-1442903876-project-member] Enqueued Resource ID: 0909b11c-c2d6-4d46-9a46-74243fd12a97 with Priority: HIGHEST for action security_group_rules [ 1037.820972] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0909b11c-c2d6-4d46-9a46-74243fd12a97 with Priority: HIGHEST for action security_group_rules [ 1037.821714] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0909b11c-c2d6-4d46-9a46-74243fd12a97 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.821896] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0909b11c-c2d6-4d46-9a46-74243fd12a97" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.822028] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0909b11c-c2d6-4d46-9a46-74243fd12a97" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.822394] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0909b11c-c2d6-4d46-9a46-74243fd12a97" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.822482] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0909b11c-c2d6-4d46-9a46-74243fd12a97',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.829817] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 83d1cdee-a934-490e-9869-707c6882be9d in Status: SUCCESS [ 1037.830074] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-83d1cdee-a934-490e-9869-707c6882be9d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.901701] env[69232]: INFO networking_nsxv3.common.synchronization [None req-515e1ffa-edbe-4e89-8b16-49f4f66822e2 tempest-AttachInterfacesTestJSON-1442903876 tempest-AttachInterfacesTestJSON-1442903876-project-member] Enqueued Resource ID: 0909b11c-c2d6-4d46-9a46-74243fd12a97 with Priority: HIGHEST for action security_group_rules [ 1037.902338] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0909b11c-c2d6-4d46-9a46-74243fd12a97 with Priority: HIGHEST for action security_group_rules [ 1037.902751] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0909b11c-c2d6-4d46-9a46-74243fd12a97 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.902907] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0909b11c-c2d6-4d46-9a46-74243fd12a97" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.129067] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('be581393-4638-4971-8e7f-56047ad132ae',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.344499] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.344499] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.344626] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.345665] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.345665] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.345665] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0909b11c-c2d6-4d46-9a46-74243fd12a97 already deleted. [ 1038.345665] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0909b11c-c2d6-4d46-9a46-74243fd12a97" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.345665] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0909b11c-c2d6-4d46-9a46-74243fd12a97" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.345665] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0909b11c-c2d6-4d46-9a46-74243fd12a97" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.345665] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0909b11c-c2d6-4d46-9a46-74243fd12a97',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.630197] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('be581393-4638-4971-8e7f-56047ad132ae',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.868256] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.868468] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.868468] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.868841] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.868974] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.869152] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0909b11c-c2d6-4d46-9a46-74243fd12a97 already deleted. [ 1038.869267] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0909b11c-c2d6-4d46-9a46-74243fd12a97" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.132290] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.132490] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.132605] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.132859] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.132955] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.133084] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: be581393-4638-4971-8e7f-56047ad132ae is going to be updated. [ 1039.164063] env[69232]: INFO networking_nsxv3.common.synchronization [req-cdd5fae5-3522-472d-a546-0d7fe2acd07c req-3b6b908f-2645-4efb-8f75-bf087316f576 tempest-ServerPasswordTestJSON-1295544909 tempest-ServerPasswordTestJSON-1295544909-project-member] Enqueued Resource ID: 33a6729f-efd4-416b-b005-d24343e7e029 with Priority: HIGHEST for action security_group_members [ 1039.164759] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33a6729f-efd4-416b-b005-d24343e7e029 with Priority: HIGHEST for action security_group_members [ 1039.165190] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-33a6729f-efd4-416b-b005-d24343e7e029 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.165391] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33a6729f-efd4-416b-b005-d24343e7e029" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.165451] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33a6729f-efd4-416b-b005-d24343e7e029" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.165947] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33a6729f-efd4-416b-b005-d24343e7e029" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.166573] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.166658] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.166725] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.166889] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.166986] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.167098] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('33a6729f-efd4-416b-b005-d24343e7e029',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.190384] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.190828] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.191060] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.191415] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.191628] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.206886] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: be581393-4638-4971-8e7f-56047ad132ae in Status: IN_PROGRESS for 2s [ 1039.546717] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock network-51 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.547298] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "network-51" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.547583] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "network-51" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.548095] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "network-51" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.549363] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.549363] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.549363] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.549363] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.549363] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.549983] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1039.549983] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] NeedRegenerationException {{(pid=69232) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1039.550077] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] no value, waiting for create lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1039.550249] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] value creation lock acquired {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1039.550457] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1039.550581] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Calling creation function for not-yet-present value {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1039.550782] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1039.576124] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1039.576324] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=69232) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1039.576485] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Released creation lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1039.576694] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "network-51" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.577050] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock port-ff60e2c8-1636-4c47-a7b2-f80e95ed992d taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.577247] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "port-ff60e2c8-1636-4c47-a7b2-f80e95ed992d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.577398] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "port-ff60e2c8-1636-4c47-a7b2-f80e95ed992d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.578851] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "port-ff60e2c8-1636-4c47-a7b2-f80e95ed992d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.578851] env[69232]: DEBUG networking_nsxv3.api.rpc [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ff60e2c8-1636-4c47-a7b2-f80e95ed992d',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.670257] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.670827] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.670827] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.670967] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.671041] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.671403] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.671403] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.671779] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.671779] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.671779] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.672800] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 33a6729f-efd4-416b-b005-d24343e7e029 already deleted. [ 1039.672800] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33a6729f-efd4-416b-b005-d24343e7e029" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.080582] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.080821] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.080821] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.081058] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.081231] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.081392] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Segment Port ff60e2c8-1636-4c47-a7b2-f80e95ed992d not found, creating... [ 1040.081903] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.081903] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.082099] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.082166] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.082306] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.082638] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.082803] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.082924] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.083149] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.083289] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.083432] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Resource: SegmentPort with ID: ff60e2c8-1636-4c47-a7b2-f80e95ed992d is going to be created. [ 1040.102803] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.103146] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.103338] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.103710] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.104048] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.104304] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "port-ff60e2c8-1636-4c47-a7b2-f80e95ed992d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.825218] env[69232]: INFO networking_nsxv3.common.synchronization [req-cdd5fae5-3522-472d-a546-0d7fe2acd07c req-1bab4698-eed7-4ca9-8549-8e35dee45d46 service nova] Enqueued Resource ID: 33a6729f-efd4-416b-b005-d24343e7e029 with Priority: HIGHEST for action security_group_rules [ 1040.825218] env[69232]: INFO networking_nsxv3.common.synchronization [req-cdd5fae5-3522-472d-a546-0d7fe2acd07c req-1bab4698-eed7-4ca9-8549-8e35dee45d46 service nova] Enqueued Resource ID: 33a6729f-efd4-416b-b005-d24343e7e029 with Priority: HIGHEST for action security_group_members [ 1040.825218] env[69232]: INFO networking_nsxv3.common.synchronization [req-cdd5fae5-3522-472d-a546-0d7fe2acd07c req-1bab4698-eed7-4ca9-8549-8e35dee45d46 service nova] Enqueued Resource ID: ff60e2c8-1636-4c47-a7b2-f80e95ed992d with Priority: HIGHEST for action port [ 1040.825218] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33a6729f-efd4-416b-b005-d24343e7e029 with Priority: HIGHEST for action security_group_rules [ 1040.825218] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33a6729f-efd4-416b-b005-d24343e7e029 with Priority: HIGHEST for action security_group_members [ 1040.825218] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ff60e2c8-1636-4c47-a7b2-f80e95ed992d with Priority: HIGHEST for action port [ 1040.826000] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-33a6729f-efd4-416b-b005-d24343e7e029 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.826173] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-33a6729f-efd4-416b-b005-d24343e7e029" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.826254] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-33a6729f-efd4-416b-b005-d24343e7e029" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.826509] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-33a6729f-efd4-416b-b005-d24343e7e029" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.826605] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('33a6729f-efd4-416b-b005-d24343e7e029',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.827499] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-33a6729f-efd4-416b-b005-d24343e7e029 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.827623] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33a6729f-efd4-416b-b005-d24343e7e029" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.827689] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33a6729f-efd4-416b-b005-d24343e7e029" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.827873] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33a6729f-efd4-416b-b005-d24343e7e029" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.828037] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.828153] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.828231] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.828327] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.828411] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.828505] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('33a6729f-efd4-416b-b005-d24343e7e029',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.829399] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-ff60e2c8-1636-4c47-a7b2-f80e95ed992d taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.829552] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ff60e2c8-1636-4c47-a7b2-f80e95ed992d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.829552] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ff60e2c8-1636-4c47-a7b2-f80e95ed992d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.829692] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ff60e2c8-1636-4c47-a7b2-f80e95ed992d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.829766] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ff60e2c8-1636-4c47-a7b2-f80e95ed992d',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.217086] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: be581393-4638-4971-8e7f-56047ad132ae in Status: SUCCESS [ 1041.217320] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-be581393-4638-4971-8e7f-56047ad132ae" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.217527] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-be581393-4638-4971-8e7f-56047ad132ae" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.217750] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-be581393-4638-4971-8e7f-56047ad132ae" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.217944] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.218130] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.218212] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.218381] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.218465] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.218547] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-be581393-4638-4971-8e7f-56047ad132ae" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.218712] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-be581393-4638-4971-8e7f-56047ad132ae taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.218815] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-be581393-4638-4971-8e7f-56047ad132ae" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.218880] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-be581393-4638-4971-8e7f-56047ad132ae" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.219032] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-be581393-4638-4971-8e7f-56047ad132ae" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.219173] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.219265] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.219316] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.219454] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.219520] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.219600] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-be581393-4638-4971-8e7f-56047ad132ae" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.219733] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('be581393-4638-4971-8e7f-56047ad132ae',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.331747] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-33a6729f-efd4-416b-b005-d24343e7e029 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.331936] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33a6729f-efd4-416b-b005-d24343e7e029" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.332086] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('33a6729f-efd4-416b-b005-d24343e7e029',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.333086] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ff60e2c8-1636-4c47-a7b2-f80e95ed992d with status ACTIVE [ 1041.333280] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.333402] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.333461] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.333696] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.333864] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.333967] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.334086] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.334188] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.334300] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.334458] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.334552] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.334639] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.334817] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.334817] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.335017] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.335017] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ff60e2c8-1636-4c47-a7b2-f80e95ed992d is going to be updated. [ 1041.358435] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.358656] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.359455] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.359455] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.359455] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.359455] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ff60e2c8-1636-4c47-a7b2-f80e95ed992d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.721999] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for be581393-4638-4971-8e7f-56047ad132ae: rpc.has_security_group_logging(os_id): False [ 1041.741265] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.741477] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.741577] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.741885] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.742023] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.742312] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.742452] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.742541] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.742736] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.742820] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.743011] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.743106] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.743164] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.743307] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.743376] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.743552] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.743639] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.743692] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.743832] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.743900] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.743996] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: be581393-4638-4971-8e7f-56047ad132ae is going to be created. [ 1041.807781] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.807994] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.807994] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.808229] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.808422] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.819279] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: be581393-4638-4971-8e7f-56047ad132ae in Status: IN_PROGRESS for 2s [ 1041.836896] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('33a6729f-efd4-416b-b005-d24343e7e029',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.274935] env[69232]: INFO networking_nsxv3.common.synchronization [req-3080d362-e690-4ad8-9eb9-a8aad91ab937 req-046dd135-f4e6-467a-a2ea-8d24721b9ada tempest-DeleteServersTestJSON-830271628 tempest-DeleteServersTestJSON-830271628-project-member] Enqueued Resource ID: 9f5186e6-2d35-4ccf-a8b4-749a0a872128 with Priority: HIGHEST for action security_group_members [ 1042.275613] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f5186e6-2d35-4ccf-a8b4-749a0a872128 with Priority: HIGHEST for action security_group_members [ 1042.275847] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f5186e6-2d35-4ccf-a8b4-749a0a872128 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.275960] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.276040] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.276241] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.276430] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.277089] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.277089] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.277089] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.277089] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.277089] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9f5186e6-2d35-4ccf-a8b4-749a0a872128',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.339303] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.339556] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.339674] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.340017] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.340159] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.340323] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 33a6729f-efd4-416b-b005-d24343e7e029 is going to be created. [ 1042.391761] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.392089] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.392089] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.392227] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.392425] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.404684] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 33a6729f-efd4-416b-b005-d24343e7e029 in Status: UNINITIALIZED for 2s [ 1042.779886] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.780132] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.780259] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.780556] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.780731] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.781113] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.781230] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.781298] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.781471] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.781598] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.781856] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9f5186e6-2d35-4ccf-a8b4-749a0a872128 is going to be updated. [ 1042.815849] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.816060] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.816122] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.816317] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.816462] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.827754] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f5186e6-2d35-4ccf-a8b4-749a0a872128 in Status: IN_PROGRESS for 2s [ 1043.834607] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: be581393-4638-4971-8e7f-56047ad132ae in Status: SUCCESS [ 1043.834868] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-be581393-4638-4971-8e7f-56047ad132ae" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.835215] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-be581393-4638-4971-8e7f-56047ad132ae" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.835460] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-be581393-4638-4971-8e7f-56047ad132ae" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.835556] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('be581393-4638-4971-8e7f-56047ad132ae',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.338093] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-be581393-4638-4971-8e7f-56047ad132ae taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.338302] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-be581393-4638-4971-8e7f-56047ad132ae" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.338424] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-be581393-4638-4971-8e7f-56047ad132ae" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.338680] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-be581393-4638-4971-8e7f-56047ad132ae" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.338873] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.339069] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.339138] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.339313] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.339402] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.339500] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-be581393-4638-4971-8e7f-56047ad132ae" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.339594] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('be581393-4638-4971-8e7f-56047ad132ae',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.414597] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 33a6729f-efd4-416b-b005-d24343e7e029 in Status: SUCCESS [ 1044.414990] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33a6729f-efd4-416b-b005-d24343e7e029" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.415221] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33a6729f-efd4-416b-b005-d24343e7e029" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.415477] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33a6729f-efd4-416b-b005-d24343e7e029" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.415745] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.415886] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.415955] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.416137] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.416220] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.416308] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33a6729f-efd4-416b-b005-d24343e7e029" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.416400] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('33a6729f-efd4-416b-b005-d24343e7e029',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.840298] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f5186e6-2d35-4ccf-a8b4-749a0a872128 in Status: SUCCESS [ 1044.840821] env[69232]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9f5186e6-2d35-4ccf-a8b4-749a0a872128 deletion is rescheduled due to dependency. [ 1044.840821] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.845272] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-be581393-4638-4971-8e7f-56047ad132ae taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.845504] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-be581393-4638-4971-8e7f-56047ad132ae" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.845504] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-be581393-4638-4971-8e7f-56047ad132ae" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.845782] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-be581393-4638-4971-8e7f-56047ad132ae" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.845987] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.846363] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.846363] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.846504] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.846562] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.846931] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-be581393-4638-4971-8e7f-56047ad132ae" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.846931] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-be581393-4638-4971-8e7f-56047ad132ae taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.847067] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-be581393-4638-4971-8e7f-56047ad132ae" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.847102] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-be581393-4638-4971-8e7f-56047ad132ae" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.847386] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-be581393-4638-4971-8e7f-56047ad132ae" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.847386] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.847539] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.847539] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.847728] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.847728] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.847882] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-be581393-4638-4971-8e7f-56047ad132ae" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.847882] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('be581393-4638-4971-8e7f-56047ad132ae',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.919196] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-33a6729f-efd4-416b-b005-d24343e7e029 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.919523] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33a6729f-efd4-416b-b005-d24343e7e029" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.919523] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33a6729f-efd4-416b-b005-d24343e7e029" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.919678] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33a6729f-efd4-416b-b005-d24343e7e029" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.919848] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.919972] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.920061] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.920184] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.920299] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.920365] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33a6729f-efd4-416b-b005-d24343e7e029" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.920562] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-33a6729f-efd4-416b-b005-d24343e7e029 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.920702] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33a6729f-efd4-416b-b005-d24343e7e029" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.920702] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33a6729f-efd4-416b-b005-d24343e7e029" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.920844] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33a6729f-efd4-416b-b005-d24343e7e029" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.920989] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.921094] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.921156] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.921273] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.921341] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.921435] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33a6729f-efd4-416b-b005-d24343e7e029" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.921527] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('33a6729f-efd4-416b-b005-d24343e7e029',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.350393] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for be581393-4638-4971-8e7f-56047ad132ae: rpc.has_security_group_logging(os_id): False [ 1045.371616] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.371860] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.371956] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.372295] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.372295] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.372564] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.372731] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.372800] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.373018] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.373122] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.373349] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.373462] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.373547] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.373945] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.373945] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.374125] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.374237] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.374328] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.374516] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.374620] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.374753] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: be581393-4638-4971-8e7f-56047ad132ae is going to be updated. [ 1045.424378] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 33a6729f-efd4-416b-b005-d24343e7e029: rpc.has_security_group_logging(os_id): False [ 1045.446224] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.446224] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.446224] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.446224] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.446224] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.446224] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.446224] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.446224] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.446224] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.446224] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.446709] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.446709] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.446709] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.446709] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.446709] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.447439] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.447617] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.447728] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.447949] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.448064] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.448192] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 33a6729f-efd4-416b-b005-d24343e7e029 is going to be created. [ 1045.451142] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.451725] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.451829] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.452110] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.452326] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.486560] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: be581393-4638-4971-8e7f-56047ad132ae in Status: IN_PROGRESS for 2s [ 1045.593031] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.593257] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.593354] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.593592] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.593799] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.609805] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 33a6729f-efd4-416b-b005-d24343e7e029 in Status: IN_PROGRESS for 2s [ 1045.983286] env[69232]: INFO networking_nsxv3.common.synchronization [req-8fb0fcc4-62f8-49f2-a21a-2021a6cf3bcc req-d6a9b360-3683-4368-8d84-1a21952d57b6 tempest-MultipleCreateTestJSON-2129230941 tempest-MultipleCreateTestJSON-2129230941-project-member] Enqueued Resource ID: be581393-4638-4971-8e7f-56047ad132ae with Priority: HIGHEST for action security_group_members [ 1045.984526] env[69232]: INFO networking_nsxv3.common.synchronization [req-458332bc-1498-4a55-804a-3188626ceb2f req-17011851-5d28-4ff1-b4ce-0a3f56711b1e tempest-MultipleCreateTestJSON-2129230941 tempest-MultipleCreateTestJSON-2129230941-project-member] Enqueued Resource ID: be581393-4638-4971-8e7f-56047ad132ae with Priority: HIGHEST for action security_group_members [ 1045.986183] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: be581393-4638-4971-8e7f-56047ad132ae with Priority: HIGHEST for action security_group_members [ 1045.986689] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-be581393-4638-4971-8e7f-56047ad132ae taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.986950] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-be581393-4638-4971-8e7f-56047ad132ae" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.987135] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-be581393-4638-4971-8e7f-56047ad132ae" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.987426] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-be581393-4638-4971-8e7f-56047ad132ae" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.987684] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.987906] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.988960] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.988960] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.988960] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.988960] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('be581393-4638-4971-8e7f-56047ad132ae',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.301202] env[69232]: INFO networking_nsxv3.common.synchronization [req-209c507c-6b86-481c-92ec-c6374b73a28f req-5af85297-888b-4f70-9b9c-c254ca00d305 tempest-ImagesTestJSON-1245210724 tempest-ImagesTestJSON-1245210724-project-member] Enqueued Resource ID: fb3494b9-4ce5-4744-a378-ecbcd5c2bec9 with Priority: HIGHEST for action security_group_members [ 1046.301202] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb3494b9-4ce5-4744-a378-ecbcd5c2bec9 with Priority: HIGHEST for action security_group_members [ 1046.301202] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.301202] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.301202] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.301202] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.301202] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.301202] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.301202] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.301701] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.301888] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.303502] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fb3494b9-4ce5-4744-a378-ecbcd5c2bec9',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.491444] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.491678] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.491795] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.492141] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.492273] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.492619] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.492852] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.492945] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.493901] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.493901] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.493901] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: be581393-4638-4971-8e7f-56047ad132ae is going to be updated. [ 1046.528840] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.529051] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.529153] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.529511] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.529747] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.541478] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: be581393-4638-4971-8e7f-56047ad132ae in Status: IN_PROGRESS for 2s [ 1046.809590] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.809816] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.809914] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.810125] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.810259] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.810551] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.810832] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.810946] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.811182] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.811285] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.811376] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb3494b9-4ce5-4744-a378-ecbcd5c2bec9 is going to be updated. [ 1046.920980] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.920980] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.920980] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.921336] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.921336] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.940428] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb3494b9-4ce5-4744-a378-ecbcd5c2bec9 in Status: IN_PROGRESS for 2s [ 1047.502919] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: be581393-4638-4971-8e7f-56047ad132ae in Status: SUCCESS [ 1047.503277] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-be581393-4638-4971-8e7f-56047ad132ae" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.623142] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 33a6729f-efd4-416b-b005-d24343e7e029 in Status: SUCCESS [ 1047.623287] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-33a6729f-efd4-416b-b005-d24343e7e029" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.312521] env[69232]: INFO networking_nsxv3.common.synchronization [req-d377de15-6d0b-498c-a578-8df1ff2852be req-fe03ff87-d141-4855-ad1b-7f0913e492f8 tempest-ServerDiskConfigTestJSON-1562148127 tempest-ServerDiskConfigTestJSON-1562148127-project-member] Enqueued Resource ID: 5a45a455-673b-417d-b2f6-be9352c2077e with Priority: HIGHEST for action security_group_members [ 1048.313098] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a45a455-673b-417d-b2f6-be9352c2077e with Priority: HIGHEST for action security_group_members [ 1048.313414] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a45a455-673b-417d-b2f6-be9352c2077e taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.313534] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a45a455-673b-417d-b2f6-be9352c2077e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.313608] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a45a455-673b-417d-b2f6-be9352c2077e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.313860] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a45a455-673b-417d-b2f6-be9352c2077e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.313985] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.317162] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.317258] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.317411] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.317500] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.317600] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5a45a455-673b-417d-b2f6-be9352c2077e',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.346055] env[69232]: INFO networking_nsxv3.common.synchronization [req-421a549e-30cb-4e92-9bc8-0b5fe71bd3af req-c3c71f76-9fae-4b16-af30-8efa69bdec8c tempest-ServersAdminTestJSON-2143393640 tempest-ServersAdminTestJSON-2143393640-project-member] Enqueued Resource ID: d2391c01-2410-4874-a5a8-6da2d957e88c with Priority: HIGHEST for action security_group_members [ 1048.346538] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2391c01-2410-4874-a5a8-6da2d957e88c with Priority: HIGHEST for action security_group_members [ 1048.346886] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2391c01-2410-4874-a5a8-6da2d957e88c taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.347032] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2391c01-2410-4874-a5a8-6da2d957e88c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.347094] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2391c01-2410-4874-a5a8-6da2d957e88c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.347311] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2391c01-2410-4874-a5a8-6da2d957e88c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.347465] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.347559] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.347617] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.347764] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.347852] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.347945] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d2391c01-2410-4874-a5a8-6da2d957e88c',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.553035] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: be581393-4638-4971-8e7f-56047ad132ae in Status: SUCCESS [ 1048.553035] env[69232]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: be581393-4638-4971-8e7f-56047ad132ae deletion is rescheduled due to dependency. [ 1048.553035] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-be581393-4638-4971-8e7f-56047ad132ae" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.821240] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.821495] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.821569] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.821793] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.821921] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.822206] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.822463] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.822463] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.822641] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.822797] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.822881] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5a45a455-673b-417d-b2f6-be9352c2077e is going to be updated. [ 1048.851990] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.852286] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.852405] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.852578] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.852741] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.852937] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.853055] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.853117] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.853270] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.853342] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.853430] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d2391c01-2410-4874-a5a8-6da2d957e88c is going to be updated. [ 1048.856751] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.856879] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.856931] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.857114] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.857251] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.870876] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a45a455-673b-417d-b2f6-be9352c2077e in Status: IN_PROGRESS for 2s [ 1048.914734] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.914920] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.915042] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.915298] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.915475] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.943143] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d2391c01-2410-4874-a5a8-6da2d957e88c in Status: IN_PROGRESS for 2s [ 1048.954107] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb3494b9-4ce5-4744-a378-ecbcd5c2bec9 in Status: SUCCESS [ 1048.958489] env[69232]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb3494b9-4ce5-4744-a378-ecbcd5c2bec9 deletion is rescheduled due to dependency. [ 1048.958489] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.881396] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a45a455-673b-417d-b2f6-be9352c2077e in Status: SUCCESS [ 1050.881770] env[69232]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5a45a455-673b-417d-b2f6-be9352c2077e deletion is rescheduled due to dependency. [ 1050.881770] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a45a455-673b-417d-b2f6-be9352c2077e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.953971] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d2391c01-2410-4874-a5a8-6da2d957e88c in Status: SUCCESS [ 1050.954228] env[69232]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d2391c01-2410-4874-a5a8-6da2d957e88c deletion is rescheduled due to dependency. [ 1050.954424] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2391c01-2410-4874-a5a8-6da2d957e88c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.937256] env[69232]: INFO networking_nsxv3.common.synchronization [req-da4999fe-fb21-4ac4-b5fe-7ce7a403e50b req-f621d3f2-e37e-44ea-9d1d-12831f773336 tempest-ServerPasswordTestJSON-1295544909 tempest-ServerPasswordTestJSON-1295544909-project-member] Enqueued Resource ID: 33a6729f-efd4-416b-b005-d24343e7e029 with Priority: HIGHEST for action security_group_members [ 1051.937783] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33a6729f-efd4-416b-b005-d24343e7e029 with Priority: HIGHEST for action security_group_members [ 1051.938107] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-33a6729f-efd4-416b-b005-d24343e7e029 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.939211] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33a6729f-efd4-416b-b005-d24343e7e029" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.939211] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33a6729f-efd4-416b-b005-d24343e7e029" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.939211] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33a6729f-efd4-416b-b005-d24343e7e029" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.939211] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.939211] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.939211] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.939211] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.939211] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.939211] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('33a6729f-efd4-416b-b005-d24343e7e029',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.441891] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.442165] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.442165] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.442343] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.442435] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.442657] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.442820] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.442922] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.443117] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.443210] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.443256] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 33a6729f-efd4-416b-b005-d24343e7e029 is going to be updated. [ 1052.478259] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.478449] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.478449] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.479156] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.479156] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.488708] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 33a6729f-efd4-416b-b005-d24343e7e029 in Status: IN_PROGRESS for 2s [ 1052.896469] env[69232]: INFO networking_nsxv3.common.synchronization [req-ebc9267f-a898-4565-a0ff-5fea8d1c927a req-e7daee16-aa7a-4d14-9a91-799afdde41b1 tempest-ServersTestJSON-524901877 tempest-ServersTestJSON-524901877-project-member] Enqueued Resource ID: bdcc7a21-dd0d-4296-ac34-a880ea6123e7 with Priority: HIGHEST for action security_group_members [ 1052.897071] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdcc7a21-dd0d-4296-ac34-a880ea6123e7 with Priority: HIGHEST for action security_group_members [ 1052.897401] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.897552] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.897643] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.897858] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.898042] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.898147] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.898229] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.898424] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.898512] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.898665] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bdcc7a21-dd0d-4296-ac34-a880ea6123e7',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.205038] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock network-738 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.205038] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "network-738" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.205038] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "network-738" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.205647] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "network-738" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.205647] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.205775] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.205906] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.206162] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.206420] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.206717] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1053.206869] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] NeedRegenerationException {{(pid=69232) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1053.207026] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] no value, waiting for create lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1053.207172] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] value creation lock acquired {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1053.207384] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1053.207557] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Calling creation function for not-yet-present value {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1053.207728] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1053.230888] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1053.230888] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69232) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1053.231146] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Released creation lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1053.231242] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "network-738" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.231623] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock port-8c86c326-59d6-4a47-a471-91fb0a2ba615 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.231850] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "port-8c86c326-59d6-4a47-a471-91fb0a2ba615" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.232025] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "port-8c86c326-59d6-4a47-a471-91fb0a2ba615" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.232410] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "port-8c86c326-59d6-4a47-a471-91fb0a2ba615" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.232575] env[69232]: DEBUG networking_nsxv3.api.rpc [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8c86c326-59d6-4a47-a471-91fb0a2ba615',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.400660] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bdcc7a21-dd0d-4296-ac34-a880ea6123e7',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.735467] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.735707] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.735815] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.736152] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.736329] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.736514] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Segment Port 8c86c326-59d6-4a47-a471-91fb0a2ba615 not found, creating... [ 1053.736793] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.736986] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.737141] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.737383] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.737527] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.737853] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.738033] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.738159] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.738374] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.738541] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.738688] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Resource: SegmentPort with ID: 8c86c326-59d6-4a47-a471-91fb0a2ba615 is going to be created. [ 1053.768312] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.768570] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.768681] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.769044] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.769386] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.769572] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "port-8c86c326-59d6-4a47-a471-91fb0a2ba615" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.903423] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bdcc7a21-dd0d-4296-ac34-a880ea6123e7',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.408433] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.408433] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.408433] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.408433] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.408433] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.408433] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bdcc7a21-dd0d-4296-ac34-a880ea6123e7 is going to be updated. [ 1054.441280] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.442184] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.442607] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.443013] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.443450] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.455640] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bdcc7a21-dd0d-4296-ac34-a880ea6123e7 in Status: IN_PROGRESS for 2s [ 1054.502535] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 33a6729f-efd4-416b-b005-d24343e7e029 in Status: SUCCESS [ 1054.502535] env[69232]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 33a6729f-efd4-416b-b005-d24343e7e029 deletion is rescheduled due to dependency. [ 1054.502535] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33a6729f-efd4-416b-b005-d24343e7e029" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.689506] env[69232]: INFO networking_nsxv3.common.synchronization [req-ebc9267f-a898-4565-a0ff-5fea8d1c927a req-d7730e83-2020-4569-b022-dbd5f3dff01b service nova] Enqueued Resource ID: bdcc7a21-dd0d-4296-ac34-a880ea6123e7 with Priority: HIGHEST for action security_group_rules [ 1054.689506] env[69232]: INFO networking_nsxv3.common.synchronization [req-ebc9267f-a898-4565-a0ff-5fea8d1c927a req-d7730e83-2020-4569-b022-dbd5f3dff01b service nova] Enqueued Resource ID: bdcc7a21-dd0d-4296-ac34-a880ea6123e7 with Priority: HIGHEST for action security_group_members [ 1054.689506] env[69232]: INFO networking_nsxv3.common.synchronization [req-ebc9267f-a898-4565-a0ff-5fea8d1c927a req-d7730e83-2020-4569-b022-dbd5f3dff01b service nova] Enqueued Resource ID: 8c86c326-59d6-4a47-a471-91fb0a2ba615 with Priority: HIGHEST for action port [ 1054.689506] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdcc7a21-dd0d-4296-ac34-a880ea6123e7 with Priority: HIGHEST for action security_group_rules [ 1054.689506] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdcc7a21-dd0d-4296-ac34-a880ea6123e7 with Priority: HIGHEST for action security_group_members [ 1054.689506] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c86c326-59d6-4a47-a471-91fb0a2ba615 with Priority: HIGHEST for action port [ 1054.689506] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bdcc7a21-dd0d-4296-ac34-a880ea6123e7 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.689506] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.689506] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.689506] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.689506] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bdcc7a21-dd0d-4296-ac34-a880ea6123e7',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.690257] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.690322] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.690479] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-8c86c326-59d6-4a47-a471-91fb0a2ba615 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.692111] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8c86c326-59d6-4a47-a471-91fb0a2ba615" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.692111] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8c86c326-59d6-4a47-a471-91fb0a2ba615" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.692111] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8c86c326-59d6-4a47-a471-91fb0a2ba615" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.692111] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8c86c326-59d6-4a47-a471-91fb0a2ba615',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.752073] env[69232]: INFO networking_nsxv3.common.synchronization [req-27f71cf7-2cef-4c3b-aea7-c6cfc2b1b015 req-a8c6516d-f3cc-4d0e-80f1-a9e5bfed1deb tempest-ServersTestFqdnHostnames-1702304883 tempest-ServersTestFqdnHostnames-1702304883-project-member] Enqueued Resource ID: 7c5e8e45-2540-49ab-b0ea-33931f530ce4 with Priority: HIGHEST for action security_group_members [ 1054.752604] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c5e8e45-2540-49ab-b0ea-33931f530ce4 with Priority: HIGHEST for action security_group_members [ 1054.753333] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c5e8e45-2540-49ab-b0ea-33931f530ce4 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.753333] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c5e8e45-2540-49ab-b0ea-33931f530ce4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.753538] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c5e8e45-2540-49ab-b0ea-33931f530ce4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.753594] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c5e8e45-2540-49ab-b0ea-33931f530ce4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.753754] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.753883] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.753950] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.754144] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.754213] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.754311] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7c5e8e45-2540-49ab-b0ea-33931f530ce4',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.193480] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.193646] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.193838] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8c86c326-59d6-4a47-a471-91fb0a2ba615 with status ACTIVE [ 1055.194051] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.194139] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.194223] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.194408] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.194495] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.194663] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.195649] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.195649] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.195649] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.195649] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.195649] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.195649] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.195649] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.195649] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.195649] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.195649] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8c86c326-59d6-4a47-a471-91fb0a2ba615 is going to be updated. [ 1055.223834] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.224096] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.224152] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.224326] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.224467] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.224630] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8c86c326-59d6-4a47-a471-91fb0a2ba615" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.256415] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.256602] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.256602] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.256822] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.256912] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.257109] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.257210] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.257298] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.257411] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.257482] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.257564] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7c5e8e45-2540-49ab-b0ea-33931f530ce4 is going to be updated. [ 1055.293809] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.293980] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.294053] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.294260] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.294402] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.303408] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c5e8e45-2540-49ab-b0ea-33931f530ce4 in Status: IN_PROGRESS for 2s [ 1056.471130] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bdcc7a21-dd0d-4296-ac34-a880ea6123e7 in Status: SUCCESS [ 1056.471565] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.471633] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.471897] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.472129] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.472316] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.472394] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.472595] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.472722] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.472917] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bdcc7a21-dd0d-4296-ac34-a880ea6123e7',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.976192] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bdcc7a21-dd0d-4296-ac34-a880ea6123e7',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.314596] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c5e8e45-2540-49ab-b0ea-33931f530ce4 in Status: SUCCESS [ 1057.314763] env[69232]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7c5e8e45-2540-49ab-b0ea-33931f530ce4 deletion is rescheduled due to dependency. [ 1057.314882] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c5e8e45-2540-49ab-b0ea-33931f530ce4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.478419] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bdcc7a21-dd0d-4296-ac34-a880ea6123e7',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.981427] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.981980] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.981980] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.982110] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.982208] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.982282] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bdcc7a21-dd0d-4296-ac34-a880ea6123e7 is going to be updated. [ 1058.018982] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.019104] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.019200] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.019349] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.019495] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.030582] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bdcc7a21-dd0d-4296-ac34-a880ea6123e7 in Status: IN_PROGRESS for 2s [ 1058.489678] env[69232]: INFO networking_nsxv3.common.synchronization [None req-df742fd4-b599-4db1-b280-ad35050702ee tempest-ServerActionsTestOtherA-781098598 tempest-ServerActionsTestOtherA-781098598-project-member] Enqueued Resource ID: 6544a871-f802-46ae-a314-241911fc9dda with Priority: HIGHEST for action security_group_rules [ 1058.492190] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6544a871-f802-46ae-a314-241911fc9dda with Priority: HIGHEST for action security_group_rules [ 1058.492766] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6544a871-f802-46ae-a314-241911fc9dda taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.493729] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6544a871-f802-46ae-a314-241911fc9dda" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.493856] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6544a871-f802-46ae-a314-241911fc9dda" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.495754] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6544a871-f802-46ae-a314-241911fc9dda" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.495754] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6544a871-f802-46ae-a314-241911fc9dda',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.681100] env[69232]: INFO networking_nsxv3.common.synchronization [None req-3aad82ad-aea9-4efc-90b4-6c6634745f0f tempest-ServerActionsTestOtherA-781098598 tempest-ServerActionsTestOtherA-781098598-project-member] Enqueued Resource ID: 6544a871-f802-46ae-a314-241911fc9dda with Priority: HIGHEST for action security_group_rules [ 1058.681636] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6544a871-f802-46ae-a314-241911fc9dda with Priority: HIGHEST for action security_group_rules [ 1058.682372] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6544a871-f802-46ae-a314-241911fc9dda taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.682509] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6544a871-f802-46ae-a314-241911fc9dda" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.024713] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.024897] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.024942] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.025195] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.025288] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.025399] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6544a871-f802-46ae-a314-241911fc9dda already deleted. [ 1059.025487] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6544a871-f802-46ae-a314-241911fc9dda" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.025651] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6544a871-f802-46ae-a314-241911fc9dda" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.025835] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6544a871-f802-46ae-a314-241911fc9dda" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.025922] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6544a871-f802-46ae-a314-241911fc9dda',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.469446] env[69232]: INFO networking_nsxv3.common.synchronization [None req-f79109bf-603b-4c28-9685-4dc0284c4587 tempest-AttachVolumeShelveTestJSON-303748050 tempest-AttachVolumeShelveTestJSON-303748050-project-member] Enqueued Resource ID: 5aeb42e6-43fc-4b3e-96b5-dc4a9cddb10c with Priority: HIGHEST for action security_group_rules [ 1059.470023] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5aeb42e6-43fc-4b3e-96b5-dc4a9cddb10c with Priority: HIGHEST for action security_group_rules [ 1059.470821] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5aeb42e6-43fc-4b3e-96b5-dc4a9cddb10c taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.471151] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5aeb42e6-43fc-4b3e-96b5-dc4a9cddb10c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.471151] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5aeb42e6-43fc-4b3e-96b5-dc4a9cddb10c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.471329] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5aeb42e6-43fc-4b3e-96b5-dc4a9cddb10c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.471417] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5aeb42e6-43fc-4b3e-96b5-dc4a9cddb10c',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.548938] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.549598] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.549598] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.549598] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.549598] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.549731] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6544a871-f802-46ae-a314-241911fc9dda already deleted. [ 1059.549731] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6544a871-f802-46ae-a314-241911fc9dda" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.617606] env[69232]: INFO networking_nsxv3.common.synchronization [None req-223e9b06-7c4e-40c3-99d1-221cd7e9b354 tempest-AttachVolumeShelveTestJSON-303748050 tempest-AttachVolumeShelveTestJSON-303748050-project-member] Enqueued Resource ID: 5aeb42e6-43fc-4b3e-96b5-dc4a9cddb10c with Priority: HIGHEST for action security_group_rules [ 1059.618242] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5aeb42e6-43fc-4b3e-96b5-dc4a9cddb10c with Priority: HIGHEST for action security_group_rules [ 1059.618529] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5aeb42e6-43fc-4b3e-96b5-dc4a9cddb10c taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.618629] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5aeb42e6-43fc-4b3e-96b5-dc4a9cddb10c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.721189] env[69232]: INFO networking_nsxv3.common.synchronization [req-569dd9ba-8d7e-4230-b31a-fc59aff4d72b req-776c8392-8f44-4083-8c7f-ddc20948d4c2 tempest-ServerRescueNegativeTestJSON-737130981 tempest-ServerRescueNegativeTestJSON-737130981-project-member] Enqueued Resource ID: f75b07e5-04f2-4dc3-80ad-ba8105cb4c82 with Priority: HIGHEST for action security_group_members [ 1059.721189] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f75b07e5-04f2-4dc3-80ad-ba8105cb4c82 with Priority: HIGHEST for action security_group_members [ 1059.721189] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-f75b07e5-04f2-4dc3-80ad-ba8105cb4c82 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.721189] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f75b07e5-04f2-4dc3-80ad-ba8105cb4c82" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.721189] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f75b07e5-04f2-4dc3-80ad-ba8105cb4c82" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.721189] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f75b07e5-04f2-4dc3-80ad-ba8105cb4c82" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.721601] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.723086] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.723086] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.723437] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.723851] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.727128] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f75b07e5-04f2-4dc3-80ad-ba8105cb4c82',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.993252] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.993413] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.993484] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.993699] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.993910] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.993910] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5aeb42e6-43fc-4b3e-96b5-dc4a9cddb10c already deleted. [ 1059.993983] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5aeb42e6-43fc-4b3e-96b5-dc4a9cddb10c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.994141] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5aeb42e6-43fc-4b3e-96b5-dc4a9cddb10c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.994309] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5aeb42e6-43fc-4b3e-96b5-dc4a9cddb10c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.994392] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5aeb42e6-43fc-4b3e-96b5-dc4a9cddb10c',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.042479] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bdcc7a21-dd0d-4296-ac34-a880ea6123e7 in Status: SUCCESS [ 1060.042751] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.042945] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.043218] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.046642] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.046642] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.046642] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.046642] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.046642] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.046642] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.046642] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bdcc7a21-dd0d-4296-ac34-a880ea6123e7',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.229077] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.229319] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.229319] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.229614] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.254170] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.254170] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.254170] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.254170] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.254170] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.254170] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.254170] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f75b07e5-04f2-4dc3-80ad-ba8105cb4c82 is going to be updated. [ 1060.285918] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.286081] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.286152] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.286366] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.286509] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.296621] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f75b07e5-04f2-4dc3-80ad-ba8105cb4c82 in Status: IN_PROGRESS for 2s [ 1060.508932] env[69232]: INFO networking_nsxv3.common.synchronization [req-c80062e5-19a2-482c-8dfc-97be65c97c21 req-445d91fe-36a8-423d-8acd-3e53a37b8ba9 tempest-AttachInterfacesTestJSON-1442903876 tempest-AttachInterfacesTestJSON-1442903876-project-member] Enqueued Resource ID: 0909b11c-c2d6-4d46-9a46-74243fd12a97 with Priority: HIGHEST for action security_group_members [ 1060.509624] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0909b11c-c2d6-4d46-9a46-74243fd12a97 with Priority: HIGHEST for action security_group_members [ 1060.510313] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-0909b11c-c2d6-4d46-9a46-74243fd12a97 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.510455] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0909b11c-c2d6-4d46-9a46-74243fd12a97" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.510524] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0909b11c-c2d6-4d46-9a46-74243fd12a97" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.511944] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0909b11c-c2d6-4d46-9a46-74243fd12a97" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.512403] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.512403] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.512403] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.513585] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.513585] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.513585] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0909b11c-c2d6-4d46-9a46-74243fd12a97',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.521410] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.521410] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.521410] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.522342] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.522342] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.522342] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5aeb42e6-43fc-4b3e-96b5-dc4a9cddb10c already deleted. [ 1060.522342] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5aeb42e6-43fc-4b3e-96b5-dc4a9cddb10c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.549554] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.549891] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.549891] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.550362] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.550451] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.550609] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.550696] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.550923] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.551056] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.551203] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.551396] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.551526] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.552172] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.552172] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.552172] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.552172] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.552172] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.552387] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.552387] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.552443] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.552608] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bdcc7a21-dd0d-4296-ac34-a880ea6123e7',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.878953] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock network-756 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.879250] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "network-756" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.879439] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "network-756" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.880751] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "network-756" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.881109] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.881917] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.881917] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.881917] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.881917] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.882227] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1060.882227] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] NeedRegenerationException {{(pid=69232) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1060.882294] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] no value, waiting for create lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1060.882387] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] value creation lock acquired {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1060.882516] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1060.882632] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Calling creation function for not-yet-present value {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1060.882801] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1060.904530] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1060.904530] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69232) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1060.904530] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Released creation lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1060.904530] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "network-756" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.904530] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock port-05c35540-eab6-45d9-a320-1bcf5f241e29 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.904773] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "port-05c35540-eab6-45d9-a320-1bcf5f241e29" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.905218] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "port-05c35540-eab6-45d9-a320-1bcf5f241e29" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.905298] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "port-05c35540-eab6-45d9-a320-1bcf5f241e29" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.905397] env[69232]: DEBUG networking_nsxv3.api.rpc [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('05c35540-eab6-45d9-a320-1bcf5f241e29',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.015989] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.016160] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.016234] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.016445] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.016534] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.016722] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.016817] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.016879] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.017058] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.017137] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.017244] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0909b11c-c2d6-4d46-9a46-74243fd12a97 already deleted. [ 1061.017297] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0909b11c-c2d6-4d46-9a46-74243fd12a97" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.054785] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bdcc7a21-dd0d-4296-ac34-a880ea6123e7: rpc.has_security_group_logging(os_id): False [ 1061.086346] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.086463] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.086647] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.086704] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.086811] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.087053] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.087171] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.087171] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.087438] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.087438] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.087591] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.087713] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.087788] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.087853] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.087948] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.088320] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.088448] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.088517] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.088661] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.088743] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.088810] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bdcc7a21-dd0d-4296-ac34-a880ea6123e7 is going to be updated. [ 1061.187541] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.187541] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.187541] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.187541] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.187541] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.238962] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bdcc7a21-dd0d-4296-ac34-a880ea6123e7 in Status: IN_PROGRESS for 2s [ 1061.408429] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.408938] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.409201] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.409587] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.409837] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.410122] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Segment Port 05c35540-eab6-45d9-a320-1bcf5f241e29 not found, creating... [ 1061.410494] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.411854] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.411854] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.411854] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.411854] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.411854] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.412144] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.412362] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.412661] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.412916] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.413175] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Resource: SegmentPort with ID: 05c35540-eab6-45d9-a320-1bcf5f241e29 is going to be created. [ 1061.435156] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.435156] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.435156] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.435607] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.435947] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.436298] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "port-05c35540-eab6-45d9-a320-1bcf5f241e29" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.127400] env[69232]: INFO networking_nsxv3.common.synchronization [req-c80062e5-19a2-482c-8dfc-97be65c97c21 req-c9285832-0dbd-4744-831c-900530361524 service nova] Enqueued Resource ID: 0909b11c-c2d6-4d46-9a46-74243fd12a97 with Priority: HIGHEST for action security_group_rules [ 1062.127681] env[69232]: INFO networking_nsxv3.common.synchronization [req-c80062e5-19a2-482c-8dfc-97be65c97c21 req-c9285832-0dbd-4744-831c-900530361524 service nova] Enqueued Resource ID: 0909b11c-c2d6-4d46-9a46-74243fd12a97 with Priority: HIGHEST for action security_group_members [ 1062.127726] env[69232]: INFO networking_nsxv3.common.synchronization [req-c80062e5-19a2-482c-8dfc-97be65c97c21 req-c9285832-0dbd-4744-831c-900530361524 service nova] Enqueued Resource ID: 05c35540-eab6-45d9-a320-1bcf5f241e29 with Priority: HIGHEST for action port [ 1062.128158] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0909b11c-c2d6-4d46-9a46-74243fd12a97 with Priority: HIGHEST for action security_group_rules [ 1062.128158] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0909b11c-c2d6-4d46-9a46-74243fd12a97 with Priority: HIGHEST for action security_group_members [ 1062.128345] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05c35540-eab6-45d9-a320-1bcf5f241e29 with Priority: HIGHEST for action port [ 1062.130696] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0909b11c-c2d6-4d46-9a46-74243fd12a97 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.132026] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0909b11c-c2d6-4d46-9a46-74243fd12a97" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.132026] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0909b11c-c2d6-4d46-9a46-74243fd12a97" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.132026] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0909b11c-c2d6-4d46-9a46-74243fd12a97" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.132026] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0909b11c-c2d6-4d46-9a46-74243fd12a97',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.133601] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-0909b11c-c2d6-4d46-9a46-74243fd12a97 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.133601] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0909b11c-c2d6-4d46-9a46-74243fd12a97" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.133601] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0909b11c-c2d6-4d46-9a46-74243fd12a97" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.133601] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0909b11c-c2d6-4d46-9a46-74243fd12a97" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.134887] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.134887] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.134887] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.134887] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.134887] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.134887] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0909b11c-c2d6-4d46-9a46-74243fd12a97',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.135750] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-05c35540-eab6-45d9-a320-1bcf5f241e29 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.135886] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-05c35540-eab6-45d9-a320-1bcf5f241e29" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.135886] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-05c35540-eab6-45d9-a320-1bcf5f241e29" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.136065] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-05c35540-eab6-45d9-a320-1bcf5f241e29" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.136145] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('05c35540-eab6-45d9-a320-1bcf5f241e29',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.313049] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f75b07e5-04f2-4dc3-80ad-ba8105cb4c82 in Status: SUCCESS [ 1062.313049] env[69232]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f75b07e5-04f2-4dc3-80ad-ba8105cb4c82 deletion is rescheduled due to dependency. [ 1062.313049] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f75b07e5-04f2-4dc3-80ad-ba8105cb4c82" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.638419] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0909b11c-c2d6-4d46-9a46-74243fd12a97',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.639571] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-0909b11c-c2d6-4d46-9a46-74243fd12a97 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.639571] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0909b11c-c2d6-4d46-9a46-74243fd12a97" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.644151] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 05c35540-eab6-45d9-a320-1bcf5f241e29 with status ACTIVE [ 1062.644343] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.644462] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.644530] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.644738] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.644830] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.645015] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.645156] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.645237] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.645407] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.645487] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.645670] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.645764] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.645845] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.645962] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.646049] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.646131] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 05c35540-eab6-45d9-a320-1bcf5f241e29 is going to be updated. [ 1062.666882] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.667050] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.667050] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.667318] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.667381] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.667766] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-05c35540-eab6-45d9-a320-1bcf5f241e29" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.942976] env[69232]: INFO networking_nsxv3.common.synchronization [req-cc9840b6-3036-4dd3-9bae-0c3cfc834139 req-8a1e39c5-73fd-4494-8dcd-2c92fa753769 tempest-DeleteServersTestJSON-830271628 tempest-DeleteServersTestJSON-830271628-project-member] Enqueued Resource ID: 9f5186e6-2d35-4ccf-a8b4-749a0a872128 with Priority: HIGHEST for action security_group_members [ 1062.943544] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f5186e6-2d35-4ccf-a8b4-749a0a872128 with Priority: HIGHEST for action security_group_members [ 1062.943857] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f5186e6-2d35-4ccf-a8b4-749a0a872128 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.944079] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.944149] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.944359] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.944506] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.944637] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.944688] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.945402] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.945402] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.945402] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9f5186e6-2d35-4ccf-a8b4-749a0a872128',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.141300] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0909b11c-c2d6-4d46-9a46-74243fd12a97',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.251421] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bdcc7a21-dd0d-4296-ac34-a880ea6123e7 in Status: SUCCESS [ 1063.251660] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.291325] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock network-279 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.292477] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "network-279" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.292477] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "network-279" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.292477] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "network-279" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.295154] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.295384] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.295463] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.295712] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.295864] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.296096] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1063.296218] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] NeedRegenerationException {{(pid=69232) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1063.296353] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] no value, waiting for create lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1063.296480] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] value creation lock acquired {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1063.296598] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1063.296709] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Calling creation function for not-yet-present value {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1063.296847] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1063.318333] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1063.319037] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69232) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1063.319306] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Released creation lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1063.319653] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "network-279" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.320197] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock port-33fa3abd-cbe5-49d5-bfbf-7dd95a82aac9 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.320689] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "port-33fa3abd-cbe5-49d5-bfbf-7dd95a82aac9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.321168] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "port-33fa3abd-cbe5-49d5-bfbf-7dd95a82aac9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.322057] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "port-33fa3abd-cbe5-49d5-bfbf-7dd95a82aac9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.322327] env[69232]: DEBUG networking_nsxv3.api.rpc [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('33fa3abd-cbe5-49d5-bfbf-7dd95a82aac9',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.447949] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.448192] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.448291] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.448542] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.448702] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.448948] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.449099] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.449191] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.449413] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.449882] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.449882] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9f5186e6-2d35-4ccf-a8b4-749a0a872128 is going to be updated. [ 1063.480195] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.480378] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.480486] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.480638] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.480779] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.494426] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f5186e6-2d35-4ccf-a8b4-749a0a872128 in Status: IN_PROGRESS for 2s [ 1063.595518] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.595518] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.595518] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.595518] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.595518] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.646519] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.646685] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.646759] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.646982] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.647095] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.647233] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0909b11c-c2d6-4d46-9a46-74243fd12a97 is going to be created. [ 1063.671237] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.671407] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.671448] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.671676] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.671867] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.682967] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0909b11c-c2d6-4d46-9a46-74243fd12a97 in Status: UNINITIALIZED for 2s [ 1063.825347] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.825612] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.825841] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.826089] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.826267] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.826437] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Segment Port 33fa3abd-cbe5-49d5-bfbf-7dd95a82aac9 not found, creating... [ 1063.826844] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.827015] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.827120] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.827361] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.827522] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.827859] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.828072] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.828267] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.828521] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.828696] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.828867] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Resource: SegmentPort with ID: 33fa3abd-cbe5-49d5-bfbf-7dd95a82aac9 is going to be created. [ 1063.849385] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.849767] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.849842] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.850101] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.850356] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.850608] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "port-33fa3abd-cbe5-49d5-bfbf-7dd95a82aac9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.096654] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.601107] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.620607] env[69232]: INFO networking_nsxv3.common.synchronization [req-cc9840b6-3036-4dd3-9bae-0c3cfc834139 req-52f1b7f5-5501-4b03-b030-7779b08afe10 service nova] Enqueued Resource ID: 9f5186e6-2d35-4ccf-a8b4-749a0a872128 with Priority: HIGHEST for action security_group_rules [ 1064.620915] env[69232]: INFO networking_nsxv3.common.synchronization [req-cc9840b6-3036-4dd3-9bae-0c3cfc834139 req-52f1b7f5-5501-4b03-b030-7779b08afe10 service nova] Enqueued Resource ID: 9f5186e6-2d35-4ccf-a8b4-749a0a872128 with Priority: HIGHEST for action security_group_members [ 1064.621153] env[69232]: INFO networking_nsxv3.common.synchronization [req-cc9840b6-3036-4dd3-9bae-0c3cfc834139 req-52f1b7f5-5501-4b03-b030-7779b08afe10 service nova] Enqueued Resource ID: 33fa3abd-cbe5-49d5-bfbf-7dd95a82aac9 with Priority: HIGHEST for action port [ 1064.621615] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f5186e6-2d35-4ccf-a8b4-749a0a872128 with Priority: HIGHEST for action security_group_rules [ 1064.621779] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f5186e6-2d35-4ccf-a8b4-749a0a872128 with Priority: HIGHEST for action security_group_members [ 1064.621886] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33fa3abd-cbe5-49d5-bfbf-7dd95a82aac9 with Priority: HIGHEST for action port [ 1064.622169] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9f5186e6-2d35-4ccf-a8b4-749a0a872128 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.622289] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.622357] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.622551] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.622633] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9f5186e6-2d35-4ccf-a8b4-749a0a872128',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.623628] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f5186e6-2d35-4ccf-a8b4-749a0a872128 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.623628] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.623777] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-33fa3abd-cbe5-49d5-bfbf-7dd95a82aac9 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.623872] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-33fa3abd-cbe5-49d5-bfbf-7dd95a82aac9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.623960] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-33fa3abd-cbe5-49d5-bfbf-7dd95a82aac9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.624157] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-33fa3abd-cbe5-49d5-bfbf-7dd95a82aac9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.624234] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('33fa3abd-cbe5-49d5-bfbf-7dd95a82aac9',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.103039] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1065.103202] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1065.125696] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f5186e6-2d35-4ccf-a8b4-749a0a872128 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.125778] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.127215] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 33fa3abd-cbe5-49d5-bfbf-7dd95a82aac9 with status ACTIVE [ 1065.127409] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.127529] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.127591] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.127799] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.127884] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.128092] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.128240] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.128327] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.128506] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.128584] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.128828] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.128965] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.129039] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.129189] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.129261] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.129342] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 33fa3abd-cbe5-49d5-bfbf-7dd95a82aac9 is going to be updated. [ 1065.152872] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.153130] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.153222] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.153431] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.153570] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.153724] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-33fa3abd-cbe5-49d5-bfbf-7dd95a82aac9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.449132] env[69232]: INFO networking_nsxv3.common.synchronization [req-97ef88d3-2c87-4bd6-a4f5-2acd0ae5f3d3 req-0ccfa773-5a0f-410e-92e5-c307ad33d68e tempest-ServerDiskConfigTestJSON-1562148127 tempest-ServerDiskConfigTestJSON-1562148127-project-member] Enqueued Resource ID: 5a45a455-673b-417d-b2f6-be9352c2077e with Priority: HIGHEST for action security_group_members [ 1065.449132] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a45a455-673b-417d-b2f6-be9352c2077e with Priority: HIGHEST for action security_group_members [ 1065.449132] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a45a455-673b-417d-b2f6-be9352c2077e taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.449132] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a45a455-673b-417d-b2f6-be9352c2077e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.449132] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a45a455-673b-417d-b2f6-be9352c2077e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.449132] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a45a455-673b-417d-b2f6-be9352c2077e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.449132] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.451279] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.451482] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.451756] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.451940] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.452245] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5a45a455-673b-417d-b2f6-be9352c2077e',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.509941] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f5186e6-2d35-4ccf-a8b4-749a0a872128 in Status: SUCCESS [ 1065.509941] env[69232]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9f5186e6-2d35-4ccf-a8b4-749a0a872128 deletion is rescheduled due to dependency. [ 1065.511033] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.511727] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.511999] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.512255] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.512501] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.512501] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.512662] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.512749] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.514394] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9f5186e6-2d35-4ccf-a8b4-749a0a872128',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.693731] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0909b11c-c2d6-4d46-9a46-74243fd12a97 in Status: SUCCESS [ 1065.694324] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0909b11c-c2d6-4d46-9a46-74243fd12a97" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.694324] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0909b11c-c2d6-4d46-9a46-74243fd12a97" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.694439] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0909b11c-c2d6-4d46-9a46-74243fd12a97" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.694615] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.694734] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.694800] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.694955] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.695117] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.695117] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0909b11c-c2d6-4d46-9a46-74243fd12a97" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.695392] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0909b11c-c2d6-4d46-9a46-74243fd12a97',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.956290] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.956517] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.956590] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.956820] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.956934] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.957138] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.957243] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.957280] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.957436] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.957505] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.957609] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5a45a455-673b-417d-b2f6-be9352c2077e is going to be updated. [ 1065.992902] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.993131] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.993167] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.993382] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.993569] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.004893] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a45a455-673b-417d-b2f6-be9352c2077e in Status: IN_PROGRESS for 2s [ 1066.020277] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9f5186e6-2d35-4ccf-a8b4-749a0a872128',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.145153] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.145153] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.145153] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.145153] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.160520] env[69232]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1066.164951] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.164951] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1066.199676] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0909b11c-c2d6-4d46-9a46-74243fd12a97',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.206145] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock network-846 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.206145] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "network-846" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.206145] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "network-846" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.206145] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "network-846" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.206145] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.206496] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.206723] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.207041] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.207292] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.207596] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1066.207991] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] NeedRegenerationException {{(pid=69232) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1066.208247] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] no value, waiting for create lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1066.208447] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] value creation lock acquired {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1066.218759] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1066.218759] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Calling creation function for not-yet-present value {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1066.218759] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1066.218759] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.218759] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.218759] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.218759] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.229553] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.230659] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1066.230874] env[69232]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=69232) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1066.231085] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1066.253813] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1066.253813] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Cache value generated in 0.043 seconds for key(s): 'zone-id' {{(pid=69232) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1066.253813] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Released creation lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1066.253813] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "network-846" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.253813] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock port-089afbf2-1a14-4bbe-a236-8209f70162f1 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.253813] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "port-089afbf2-1a14-4bbe-a236-8209f70162f1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.253813] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "port-089afbf2-1a14-4bbe-a236-8209f70162f1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.253813] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "port-089afbf2-1a14-4bbe-a236-8209f70162f1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.257439] env[69232]: DEBUG networking_nsxv3.api.rpc [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('089afbf2-1a14-4bbe-a236-8209f70162f1',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.278586] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.278734] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.279121] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.279121] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.284441] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.285016] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1066.368047] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.368876] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.368876] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.368876] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.368876] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.370901] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1066.454156] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.455774] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.455774] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.455774] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.455774] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.456270] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:45. [ 1066.456460] env[69232]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'8f8cfd9d-acc3-4fa8-825d-c583365a30ed', '7c5e8e45-2540-49ab-b0ea-33931f530ce4', 'c518d277-32a1-437b-a0b2-37d4c69436b0', 'f29e46f4-baa2-4512-b89f-bb8fa2c53157', '9f5186e6-2d35-4ccf-a8b4-749a0a872128', '256e29a3-9ff8-45a1-805b-591f83c2a8b4', '0a7a78fa-fad0-458c-afc2-e1d98c9176ab', '934b2684-b99c-4846-87df-66cbae10f2fc', '3e5e65a3-941b-4419-9265-0dce9e80179e', 'adac9a54-9bb6-4368-a762-389898a52bd9', '531d0f92-2e98-47df-b32d-d49e1d2f34c1', '45780cba-cd94-4a19-b7a8-aa324fdcb9c5', 'd2391c01-2410-4874-a5a8-6da2d957e88c', '6e7bf0fa-24cf-40f7-ac38-1adabda5207c', '453650db-0c42-4224-8f26-d113b3aaa020', '415b5ffc-5000-49bb-a961-29bcf6fcb57a', 'b5e09fe8-8a4e-445c-b1d3-bf8c7339160c', 'bdcc7a21-dd0d-4296-ac34-a880ea6123e7', '33a6729f-efd4-416b-b005-d24343e7e029', '4046c2da-b145-4a23-9fac-fd79697872c1', '20ba03af-aba0-4fe6-af1e-ea103067fcbe', 'fb3494b9-4ce5-4744-a378-ecbcd5c2bec9', 'be581393-4638-4971-8e7f-56047ad132ae', '345ff80e-1d3c-4ccc-95f9-bc828bfd5095', '4843729c-bd07-48e1-9798-7dc90829718d', '1eb9f24d-331e-450b-9da0-82652ecba032', 'abd587ac-a2db-4962-b166-638ba1590646', '83d1cdee-a934-490e-9869-707c6882be9d', '06438b8f-6cee-4263-9d4c-43067bbe0a4c', '5435d71f-3832-4f11-be57-bef3011dd7b7', 'dcd9f79f-c997-4a2d-83a2-472c849b1794', 'd95c4c9e-2568-4fbb-8231-ae683e08215e', '96a06bfd-a7ad-4644-89c3-3168aa1fdf2e', 'e18d5d2b-f965-404d-b211-f58621ceccf1', '9ea0b8f1-7dc8-48fd-bd49-a3ae8c7a9645', '5a45a455-673b-417d-b2f6-be9352c2077e', '131f51ef-2833-4453-914e-c87497d66ff6', 'f75b07e5-04f2-4dc3-80ad-ba8105cb4c82', 'c042e2fd-851d-4970-9cfd-994d6fa3bc3a', '8e5c2d57-e29a-48c5-977d-f19d1fe77c00', '774040f6-0f3c-4707-b677-d815b078404c', '24c49db3-d2db-437b-976f-e83851ddd42c', 'b403d6f4-9cfd-407a-9a3f-9a486dae20dc', '15a3e0ef-3467-49d4-a8b2-072fce21b190', '9dfe0542-c4f4-46ef-bdfa-784cec941ec2'} {{(pid=69232) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1066.456581] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1066.479671] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.479819] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.479894] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.480123] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.480212] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.480322] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1066.480394] env[69232]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=69232) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1066.480482] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1066.522819] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9f5186e6-2d35-4ccf-a8b4-749a0a872128',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.576837] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.576837] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.576837] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.576837] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.578157] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.578867] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1066.578867] env[69232]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=69232) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1066.578867] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1066.578867] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1066.578867] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/45 resources of Type:Security Group Rules [ 1066.578867] env[69232]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8f8cfd9d-acc3-4fa8-825d-c583365a30ed with Priority: HIGH for action security_group_rules [ 1066.579113] env[69232]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7c5e8e45-2540-49ab-b0ea-33931f530ce4 with Priority: HIGH for action security_group_rules [ 1066.579113] env[69232]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c518d277-32a1-437b-a0b2-37d4c69436b0 with Priority: HIGH for action security_group_rules [ 1066.579113] env[69232]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f29e46f4-baa2-4512-b89f-bb8fa2c53157 with Priority: HIGH for action security_group_rules [ 1066.579201] env[69232]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9f5186e6-2d35-4ccf-a8b4-749a0a872128 with Priority: HIGH for action security_group_rules [ 1066.579201] env[69232]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 256e29a3-9ff8-45a1-805b-591f83c2a8b4 with Priority: HIGH for action security_group_rules [ 1066.579248] env[69232]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0a7a78fa-fad0-458c-afc2-e1d98c9176ab with Priority: HIGH for action security_group_rules [ 1066.579306] env[69232]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 934b2684-b99c-4846-87df-66cbae10f2fc with Priority: HIGH for action security_group_rules [ 1066.579371] env[69232]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3e5e65a3-941b-4419-9265-0dce9e80179e with Priority: HIGH for action security_group_rules [ 1066.579434] env[69232]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: adac9a54-9bb6-4368-a762-389898a52bd9 with Priority: HIGH for action security_group_rules [ 1066.579686] env[69232]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 531d0f92-2e98-47df-b32d-d49e1d2f34c1 with Priority: HIGH for action security_group_rules [ 1066.579686] env[69232]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 45780cba-cd94-4a19-b7a8-aa324fdcb9c5 with Priority: HIGH for action security_group_rules [ 1066.579686] env[69232]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d2391c01-2410-4874-a5a8-6da2d957e88c with Priority: HIGH for action security_group_rules [ 1066.579686] env[69232]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6e7bf0fa-24cf-40f7-ac38-1adabda5207c with Priority: HIGH for action security_group_rules [ 1066.579830] env[69232]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 453650db-0c42-4224-8f26-d113b3aaa020 with Priority: HIGH for action security_group_rules [ 1066.579830] env[69232]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 415b5ffc-5000-49bb-a961-29bcf6fcb57a with Priority: HIGH for action security_group_rules [ 1066.579830] env[69232]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b5e09fe8-8a4e-445c-b1d3-bf8c7339160c with Priority: HIGH for action security_group_rules [ 1066.579910] env[69232]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: bdcc7a21-dd0d-4296-ac34-a880ea6123e7 with Priority: HIGH for action security_group_rules [ 1066.579949] env[69232]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 33a6729f-efd4-416b-b005-d24343e7e029 with Priority: HIGH for action security_group_rules [ 1066.580016] env[69232]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4046c2da-b145-4a23-9fac-fd79697872c1 with Priority: HIGH for action security_group_rules [ 1066.580127] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.700461] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0909b11c-c2d6-4d46-9a46-74243fd12a97: rpc.has_security_group_logging(os_id): False [ 1066.724663] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.724663] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.724663] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.724663] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.724663] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.724663] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.724663] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.724663] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.724663] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.724663] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.724663] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0909b11c-c2d6-4d46-9a46-74243fd12a97 is going to be created. [ 1066.761221] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.761221] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.761221] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.761802] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.761802] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.761965] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Segment Port 089afbf2-1a14-4bbe-a236-8209f70162f1 not found, creating... [ 1066.762333] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.762617] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.762850] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.763283] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.763763] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.764150] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.764422] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.764670] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.764954] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.765225] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.765291] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Resource: SegmentPort with ID: 089afbf2-1a14-4bbe-a236-8209f70162f1 is going to be created. [ 1066.793024] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.793380] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.793566] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.793804] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.794107] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.794750] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "port-089afbf2-1a14-4bbe-a236-8209f70162f1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.797602] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.797944] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.797944] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.798053] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.798465] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.810552] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0909b11c-c2d6-4d46-9a46-74243fd12a97 in Status: IN_PROGRESS for 2s [ 1067.031475] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.031785] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.031951] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.032286] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.032437] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.032669] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9f5186e6-2d35-4ccf-a8b4-749a0a872128 is going to be updated. [ 1067.070368] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.070539] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.070616] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.070880] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.070988] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.087826] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f5186e6-2d35-4ccf-a8b4-749a0a872128 in Status: IN_PROGRESS for 2s [ 1067.799985] env[69232]: INFO networking_nsxv3.common.synchronization [req-97ef88d3-2c87-4bd6-a4f5-2acd0ae5f3d3 req-7351a591-99fb-48a3-8ddb-13cca08db588 service nova] Enqueued Resource ID: 5a45a455-673b-417d-b2f6-be9352c2077e with Priority: HIGHEST for action security_group_rules [ 1067.800420] env[69232]: INFO networking_nsxv3.common.synchronization [req-97ef88d3-2c87-4bd6-a4f5-2acd0ae5f3d3 req-7351a591-99fb-48a3-8ddb-13cca08db588 service nova] Enqueued Resource ID: 5a45a455-673b-417d-b2f6-be9352c2077e with Priority: HIGHEST for action security_group_members [ 1067.800420] env[69232]: INFO networking_nsxv3.common.synchronization [req-97ef88d3-2c87-4bd6-a4f5-2acd0ae5f3d3 req-7351a591-99fb-48a3-8ddb-13cca08db588 service nova] Enqueued Resource ID: 089afbf2-1a14-4bbe-a236-8209f70162f1 with Priority: HIGHEST for action port [ 1067.800976] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a45a455-673b-417d-b2f6-be9352c2077e with Priority: HIGHEST for action security_group_rules [ 1067.801163] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a45a455-673b-417d-b2f6-be9352c2077e with Priority: HIGHEST for action security_group_members [ 1067.801273] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 089afbf2-1a14-4bbe-a236-8209f70162f1 with Priority: HIGHEST for action port [ 1067.801381] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f8cfd9d-acc3-4fa8-825d-c583365a30ed with Priority: HIGH for action security_group_rules [ 1067.801476] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c518d277-32a1-437b-a0b2-37d4c69436b0 with Priority: HIGH for action security_group_rules [ 1067.801566] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a7a78fa-fad0-458c-afc2-e1d98c9176ab with Priority: HIGH for action security_group_rules [ 1067.801656] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 453650db-0c42-4224-8f26-d113b3aaa020 with Priority: HIGH for action security_group_rules [ 1067.801855] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4046c2da-b145-4a23-9fac-fd79697872c1 with Priority: HIGH for action security_group_rules [ 1067.801855] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33a6729f-efd4-416b-b005-d24343e7e029 with Priority: HIGH for action security_group_rules [ 1067.801941] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdcc7a21-dd0d-4296-ac34-a880ea6123e7 with Priority: HIGH for action security_group_rules [ 1067.801979] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5e09fe8-8a4e-445c-b1d3-bf8c7339160c with Priority: HIGH for action security_group_rules [ 1067.802072] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e7bf0fa-24cf-40f7-ac38-1adabda5207c with Priority: HIGH for action security_group_rules [ 1067.802162] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 415b5ffc-5000-49bb-a961-29bcf6fcb57a with Priority: HIGH for action security_group_rules [ 1067.802245] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2391c01-2410-4874-a5a8-6da2d957e88c with Priority: HIGH for action security_group_rules [ 1067.802330] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45780cba-cd94-4a19-b7a8-aa324fdcb9c5 with Priority: HIGH for action security_group_rules [ 1067.802412] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 531d0f92-2e98-47df-b32d-d49e1d2f34c1 with Priority: HIGH for action security_group_rules [ 1067.802495] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: adac9a54-9bb6-4368-a762-389898a52bd9 with Priority: HIGH for action security_group_rules [ 1067.802578] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e5e65a3-941b-4419-9265-0dce9e80179e with Priority: HIGH for action security_group_rules [ 1067.802662] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 256e29a3-9ff8-45a1-805b-591f83c2a8b4 with Priority: HIGH for action security_group_rules [ 1067.802745] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 934b2684-b99c-4846-87df-66cbae10f2fc with Priority: HIGH for action security_group_rules [ 1067.802829] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f5186e6-2d35-4ccf-a8b4-749a0a872128 with Priority: HIGH for action security_group_rules [ 1067.802908] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c5e8e45-2540-49ab-b0ea-33931f530ce4 with Priority: HIGH for action security_group_rules [ 1067.803592] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f29e46f4-baa2-4512-b89f-bb8fa2c53157 with Priority: HIGH for action security_group_rules [ 1067.804069] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5a45a455-673b-417d-b2f6-be9352c2077e taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.804229] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5a45a455-673b-417d-b2f6-be9352c2077e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.804270] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5a45a455-673b-417d-b2f6-be9352c2077e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.804483] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5a45a455-673b-417d-b2f6-be9352c2077e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.804566] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5a45a455-673b-417d-b2f6-be9352c2077e',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.805552] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a45a455-673b-417d-b2f6-be9352c2077e taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.805756] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a45a455-673b-417d-b2f6-be9352c2077e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.805986] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-089afbf2-1a14-4bbe-a236-8209f70162f1 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.806141] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-089afbf2-1a14-4bbe-a236-8209f70162f1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.806285] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-089afbf2-1a14-4bbe-a236-8209f70162f1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.806476] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-089afbf2-1a14-4bbe-a236-8209f70162f1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.806555] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('089afbf2-1a14-4bbe-a236-8209f70162f1',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.807376] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8f8cfd9d-acc3-4fa8-825d-c583365a30ed taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.807524] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8f8cfd9d-acc3-4fa8-825d-c583365a30ed" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.808184] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8f8cfd9d-acc3-4fa8-825d-c583365a30ed" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.808372] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8f8cfd9d-acc3-4fa8-825d-c583365a30ed" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.808637] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8f8cfd9d-acc3-4fa8-825d-c583365a30ed',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.809476] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c518d277-32a1-437b-a0b2-37d4c69436b0 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.809589] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c518d277-32a1-437b-a0b2-37d4c69436b0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.809658] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c518d277-32a1-437b-a0b2-37d4c69436b0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.810015] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c518d277-32a1-437b-a0b2-37d4c69436b0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.810015] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c518d277-32a1-437b-a0b2-37d4c69436b0',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.810762] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0a7a78fa-fad0-458c-afc2-e1d98c9176ab taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.810880] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.810967] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.811658] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.811658] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0a7a78fa-fad0-458c-afc2-e1d98c9176ab',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.811989] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-453650db-0c42-4224-8f26-d113b3aaa020 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.812343] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-453650db-0c42-4224-8f26-d113b3aaa020" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.812343] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-453650db-0c42-4224-8f26-d113b3aaa020" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.812465] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-453650db-0c42-4224-8f26-d113b3aaa020" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.812465] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('453650db-0c42-4224-8f26-d113b3aaa020',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.813286] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4046c2da-b145-4a23-9fac-fd79697872c1 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.813286] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4046c2da-b145-4a23-9fac-fd79697872c1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.813446] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4046c2da-b145-4a23-9fac-fd79697872c1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.813490] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4046c2da-b145-4a23-9fac-fd79697872c1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.813557] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4046c2da-b145-4a23-9fac-fd79697872c1',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.814831] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-33a6729f-efd4-416b-b005-d24343e7e029 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.814959] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-33a6729f-efd4-416b-b005-d24343e7e029" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.815237] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-33a6729f-efd4-416b-b005-d24343e7e029" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.815237] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-33a6729f-efd4-416b-b005-d24343e7e029" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.815541] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('33a6729f-efd4-416b-b005-d24343e7e029',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.818365] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bdcc7a21-dd0d-4296-ac34-a880ea6123e7 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.818511] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.818582] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.818740] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.818814] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bdcc7a21-dd0d-4296-ac34-a880ea6123e7',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.820117] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b5e09fe8-8a4e-445c-b1d3-bf8c7339160c taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.820270] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b5e09fe8-8a4e-445c-b1d3-bf8c7339160c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.820563] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b5e09fe8-8a4e-445c-b1d3-bf8c7339160c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.820800] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b5e09fe8-8a4e-445c-b1d3-bf8c7339160c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.820862] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b5e09fe8-8a4e-445c-b1d3-bf8c7339160c',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.821545] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6e7bf0fa-24cf-40f7-ac38-1adabda5207c taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.821683] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6e7bf0fa-24cf-40f7-ac38-1adabda5207c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.821732] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6e7bf0fa-24cf-40f7-ac38-1adabda5207c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.821847] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6e7bf0fa-24cf-40f7-ac38-1adabda5207c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.821922] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6e7bf0fa-24cf-40f7-ac38-1adabda5207c',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.822745] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-415b5ffc-5000-49bb-a961-29bcf6fcb57a taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.822864] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-415b5ffc-5000-49bb-a961-29bcf6fcb57a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.822933] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-415b5ffc-5000-49bb-a961-29bcf6fcb57a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.823129] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-415b5ffc-5000-49bb-a961-29bcf6fcb57a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.823208] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('415b5ffc-5000-49bb-a961-29bcf6fcb57a',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.824139] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d2391c01-2410-4874-a5a8-6da2d957e88c taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.824286] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d2391c01-2410-4874-a5a8-6da2d957e88c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.824373] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d2391c01-2410-4874-a5a8-6da2d957e88c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.824561] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d2391c01-2410-4874-a5a8-6da2d957e88c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.824589] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d2391c01-2410-4874-a5a8-6da2d957e88c',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.825293] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-45780cba-cd94-4a19-b7a8-aa324fdcb9c5 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.825408] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-45780cba-cd94-4a19-b7a8-aa324fdcb9c5" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.825457] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-45780cba-cd94-4a19-b7a8-aa324fdcb9c5" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.825660] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-45780cba-cd94-4a19-b7a8-aa324fdcb9c5" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.825660] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('45780cba-cd94-4a19-b7a8-aa324fdcb9c5',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.826452] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-531d0f92-2e98-47df-b32d-d49e1d2f34c1 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.826531] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-531d0f92-2e98-47df-b32d-d49e1d2f34c1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.826593] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-531d0f92-2e98-47df-b32d-d49e1d2f34c1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.826744] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-531d0f92-2e98-47df-b32d-d49e1d2f34c1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.826816] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('531d0f92-2e98-47df-b32d-d49e1d2f34c1',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.827509] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-adac9a54-9bb6-4368-a762-389898a52bd9 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.827643] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-adac9a54-9bb6-4368-a762-389898a52bd9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.827681] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-adac9a54-9bb6-4368-a762-389898a52bd9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.827825] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-adac9a54-9bb6-4368-a762-389898a52bd9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.827905] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('adac9a54-9bb6-4368-a762-389898a52bd9',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.828741] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3e5e65a3-941b-4419-9265-0dce9e80179e taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.828837] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3e5e65a3-941b-4419-9265-0dce9e80179e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.828892] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3e5e65a3-941b-4419-9265-0dce9e80179e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.829037] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3e5e65a3-941b-4419-9265-0dce9e80179e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.829101] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3e5e65a3-941b-4419-9265-0dce9e80179e',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.829897] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-256e29a3-9ff8-45a1-805b-591f83c2a8b4 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.830013] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-256e29a3-9ff8-45a1-805b-591f83c2a8b4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.830079] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-256e29a3-9ff8-45a1-805b-591f83c2a8b4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.830258] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-256e29a3-9ff8-45a1-805b-591f83c2a8b4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.830333] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('256e29a3-9ff8-45a1-805b-591f83c2a8b4',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.831597] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-934b2684-b99c-4846-87df-66cbae10f2fc taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.831704] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-934b2684-b99c-4846-87df-66cbae10f2fc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.831770] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-934b2684-b99c-4846-87df-66cbae10f2fc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.831921] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-934b2684-b99c-4846-87df-66cbae10f2fc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.831993] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('934b2684-b99c-4846-87df-66cbae10f2fc',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.832656] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9f5186e6-2d35-4ccf-a8b4-749a0a872128 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.832883] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.832941] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7c5e8e45-2540-49ab-b0ea-33931f530ce4 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.833063] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7c5e8e45-2540-49ab-b0ea-33931f530ce4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.833194] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7c5e8e45-2540-49ab-b0ea-33931f530ce4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.833274] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7c5e8e45-2540-49ab-b0ea-33931f530ce4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.833345] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7c5e8e45-2540-49ab-b0ea-33931f530ce4',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.834558] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f29e46f4-baa2-4512-b89f-bb8fa2c53157 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.834666] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f29e46f4-baa2-4512-b89f-bb8fa2c53157" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.834729] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f29e46f4-baa2-4512-b89f-bb8fa2c53157" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.834878] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f29e46f4-baa2-4512-b89f-bb8fa2c53157" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.834950] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f29e46f4-baa2-4512-b89f-bb8fa2c53157',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.019217] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a45a455-673b-417d-b2f6-be9352c2077e in Status: SUCCESS [ 1068.019217] env[69232]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5a45a455-673b-417d-b2f6-be9352c2077e deletion is rescheduled due to dependency. [ 1068.019217] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a45a455-673b-417d-b2f6-be9352c2077e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.019217] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a45a455-673b-417d-b2f6-be9352c2077e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.019217] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a45a455-673b-417d-b2f6-be9352c2077e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.019217] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.019217] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.019217] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.019217] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.019217] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.019217] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5a45a455-673b-417d-b2f6-be9352c2077e',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.336671] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.336976] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.337164] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.337463] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.337730] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.337889] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.337964] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.338148] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.338239] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.338327] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.338447] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bdcc7a21-dd0d-4296-ac34-a880ea6123e7',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.342879] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e5e65a3-941b-4419-9265-0dce9e80179e taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.343155] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e5e65a3-941b-4419-9265-0dce9e80179e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.343278] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e5e65a3-941b-4419-9265-0dce9e80179e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.343564] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e5e65a3-941b-4419-9265-0dce9e80179e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.343822] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.344044] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.344044] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.344338] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.344532] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.344695] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e5e65a3-941b-4419-9265-0dce9e80179e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.344816] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3e5e65a3-941b-4419-9265-0dce9e80179e',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.355827] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-934b2684-b99c-4846-87df-66cbae10f2fc taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.356030] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-934b2684-b99c-4846-87df-66cbae10f2fc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.357039] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-934b2684-b99c-4846-87df-66cbae10f2fc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.357039] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-934b2684-b99c-4846-87df-66cbae10f2fc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.357039] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.357039] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.357039] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.357039] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.357039] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.357039] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-934b2684-b99c-4846-87df-66cbae10f2fc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.357039] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('934b2684-b99c-4846-87df-66cbae10f2fc',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.361401] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a45a455-673b-417d-b2f6-be9352c2077e taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.361401] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a45a455-673b-417d-b2f6-be9352c2077e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.362666] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-adac9a54-9bb6-4368-a762-389898a52bd9 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.362911] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-adac9a54-9bb6-4368-a762-389898a52bd9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.363085] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-adac9a54-9bb6-4368-a762-389898a52bd9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.363339] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-adac9a54-9bb6-4368-a762-389898a52bd9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.363544] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.363679] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.363806] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.364038] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.364179] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.364292] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-adac9a54-9bb6-4368-a762-389898a52bd9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.364645] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('adac9a54-9bb6-4368-a762-389898a52bd9',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.365971] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 089afbf2-1a14-4bbe-a236-8209f70162f1 with status ACTIVE [ 1068.366494] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.366494] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.366494] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.366806] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.366896] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.367116] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.367260] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.367363] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.367894] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.368042] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.368286] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.368581] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.368700] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.368993] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.369219] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.369349] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 089afbf2-1a14-4bbe-a236-8209f70162f1 is going to be updated. [ 1068.379465] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3e5e65a3-941b-4419-9265-0dce9e80179e',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.382728] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('934b2684-b99c-4846-87df-66cbae10f2fc',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.389720] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3e5e65a3-941b-4419-9265-0dce9e80179e: rpc.has_security_group_logging(os_id): False [ 1068.436295] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.436295] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.436295] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.436295] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.438790] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.438995] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.439942] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.440124] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.440955] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.441206] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.441942] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.442128] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.442954] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.443143] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.443862] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.444059] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.445260] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.445372] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.446434] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.446575] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.447374] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.447510] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.448351] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.448530] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.449202] env[69232]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1068.449710] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.449952] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.450514] env[69232]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1068.450970] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.451084] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.451806] env[69232]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1068.452253] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.452409] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.453208] env[69232]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1068.453595] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.453976] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.454382] env[69232]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1068.454943] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.454943] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.455148] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.455257] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.455422] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.455581] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-089afbf2-1a14-4bbe-a236-8209f70162f1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.456678] env[69232]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1068.457234] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.457315] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.464565] env[69232]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1068.464565] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.464565] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c518d277-32a1-437b-a0b2-37d4c69436b0 is going to be deleted. [ 1068.466424] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.467151] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.490730] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.490976] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 453650db-0c42-4224-8f26-d113b3aaa020 is going to be deleted. [ 1068.492087] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.492315] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.520691] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.520691] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4046c2da-b145-4a23-9fac-fd79697872c1 is going to be deleted. [ 1068.521443] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.522225] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.523591] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5a45a455-673b-417d-b2f6-be9352c2077e',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.547779] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.548057] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.549082] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.549215] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f29e46f4-baa2-4512-b89f-bb8fa2c53157 is going to be deleted. [ 1068.550276] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.550517] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.586066] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.586289] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.593397] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.593569] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b5e09fe8-8a4e-445c-b1d3-bf8c7339160c is going to be deleted. [ 1068.594873] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.595211] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.609198] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.609405] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.657660] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.657785] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7c5e8e45-2540-49ab-b0ea-33931f530ce4 is going to be deleted. [ 1068.658762] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.658995] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.676140] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.676331] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.691406] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.691503] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 531d0f92-2e98-47df-b32d-d49e1d2f34c1 is going to be deleted. [ 1068.692656] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.692872] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.707147] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.707300] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.762648] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.763851] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 45780cba-cd94-4a19-b7a8-aa324fdcb9c5 is going to be deleted. [ 1068.765241] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.765241] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.803050] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.803469] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6e7bf0fa-24cf-40f7-ac38-1adabda5207c is going to be deleted. [ 1068.804179] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.804836] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.805856] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.805974] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.827580] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0909b11c-c2d6-4d46-9a46-74243fd12a97 in Status: SUCCESS [ 1068.827818] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0909b11c-c2d6-4d46-9a46-74243fd12a97" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.847687] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.847687] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.847687] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.847687] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.847687] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.847687] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.847687] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.847687] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.847687] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.847687] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.849399] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.849399] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.849399] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.849399] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.849399] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.849399] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.849399] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.849399] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.849399] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.849399] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.849399] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bdcc7a21-dd0d-4296-ac34-a880ea6123e7',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.853808] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.854264] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.858235] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.858235] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d2391c01-2410-4874-a5a8-6da2d957e88c is going to be deleted. [ 1068.859228] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.859465] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.868800] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('adac9a54-9bb6-4368-a762-389898a52bd9',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.892402] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 934b2684-b99c-4846-87df-66cbae10f2fc: rpc.has_security_group_logging(os_id): False [ 1068.935300] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.935492] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 256e29a3-9ff8-45a1-805b-591f83c2a8b4 is going to be deleted. [ 1068.936494] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.936825] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.942621] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.942887] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.944037] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.944193] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.952438] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.952581] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.992088] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.992444] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 33a6729f-efd4-416b-b005-d24343e7e029 is going to be deleted. [ 1068.993402] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.993629] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.026074] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5a45a455-673b-417d-b2f6-be9352c2077e',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.077291] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.077473] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8f8cfd9d-acc3-4fa8-825d-c583365a30ed is going to be deleted. [ 1069.078445] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.078670] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.083102] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.083377] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.106832] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f5186e6-2d35-4ccf-a8b4-749a0a872128 in Status: SUCCESS [ 1069.106832] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.106832] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.106832] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.106832] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.107337] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.107882] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.107882] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.107882] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.107882] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.108122] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9f5186e6-2d35-4ccf-a8b4-749a0a872128',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.126938] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.127176] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.141030] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.141030] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 415b5ffc-5000-49bb-a961-29bcf6fcb57a is going to be deleted. [ 1069.142229] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.142520] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.199949] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.200519] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.200519] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.200519] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.200734] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.200901] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.201055] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3e5e65a3-941b-4419-9265-0dce9e80179e is going to be updated. [ 1069.202943] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.203126] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.205460] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.205616] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.353915] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bdcc7a21-dd0d-4296-ac34-a880ea6123e7: rpc.has_security_group_logging(os_id): False [ 1069.353915] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.353915] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.359380] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.359380] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0a7a78fa-fad0-458c-afc2-e1d98c9176ab is going to be deleted. [ 1069.360291] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.360565] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.361095] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.361366] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-453650db-0c42-4224-8f26-d113b3aaa020" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.361427] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.361612] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.361691] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.361912] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4046c2da-b145-4a23-9fac-fd79697872c1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.362535] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.362753] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.363172] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.363172] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f29e46f4-baa2-4512-b89f-bb8fa2c53157" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.363172] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.363866] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.363866] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.363866] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b5e09fe8-8a4e-445c-b1d3-bf8c7339160c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.363866] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.364248] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.364248] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.364376] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7c5e8e45-2540-49ab-b0ea-33931f530ce4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.364475] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.366507] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.366507] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.366507] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-531d0f92-2e98-47df-b32d-d49e1d2f34c1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.366507] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.366507] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.376945] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for adac9a54-9bb6-4368-a762-389898a52bd9: rpc.has_security_group_logging(os_id): False [ 1069.445991] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.445991] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.445991] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.445991] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.449888] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.449996] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.451395] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.451395] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.453226] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.453777] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.453777] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.453777] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.453942] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.453942] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.454013] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 934b2684-b99c-4846-87df-66cbae10f2fc is going to be updated. [ 1069.455175] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.455290] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.455893] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.455893] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-45780cba-cd94-4a19-b7a8-aa324fdcb9c5" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.455893] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.455893] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.455893] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.456106] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6e7bf0fa-24cf-40f7-ac38-1adabda5207c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.457189] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.457354] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.458077] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.458207] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d2391c01-2410-4874-a5a8-6da2d957e88c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.458342] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.458515] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.458595] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.458707] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-256e29a3-9ff8-45a1-805b-591f83c2a8b4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.459300] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.459474] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.459554] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.459668] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c518d277-32a1-437b-a0b2-37d4c69436b0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.459813] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.459949] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.460036] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.460167] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-33a6729f-efd4-416b-b005-d24343e7e029" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.460303] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.460442] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.460534] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.460642] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8f8cfd9d-acc3-4fa8-825d-c583365a30ed" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.460752] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.460896] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.462286] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.462286] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.462465] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.517877] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3e5e65a3-941b-4419-9265-0dce9e80179e in Status: IN_PROGRESS for 2s [ 1069.529653] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.529653] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.529653] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.529653] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.529653] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.529653] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5a45a455-673b-417d-b2f6-be9352c2077e is going to be updated. [ 1069.557475] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.557708] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.559363] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.559683] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.560955] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.561098] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.561374] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.561507] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.562240] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.562444] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.562720] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.563474] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.563533] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.564403] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.564556] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.564639] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.564857] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.564963] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.565149] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bdcc7a21-dd0d-4296-ac34-a880ea6123e7 is going to be updated. [ 1069.567358] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.567761] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.567881] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.569313] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-415b5ffc-5000-49bb-a961-29bcf6fcb57a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.569313] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.569313] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.604182] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.604612] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.604745] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.604814] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.605038] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.605138] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.605223] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: adac9a54-9bb6-4368-a762-389898a52bd9 is going to be updated. [ 1069.606526] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.606748] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.606843] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.606984] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0a7a78fa-fad0-458c-afc2-e1d98c9176ab" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.610060] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f5186e6-2d35-4ccf-a8b4-749a0a872128 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.610197] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.610260] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.610531] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.610800] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.611094] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.611094] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.611203] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.611302] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.611351] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.611494] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f5186e6-2d35-4ccf-a8b4-749a0a872128 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.611588] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.611649] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.611794] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.612147] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.612147] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.612147] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.612286] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.612286] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.612392] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.612463] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9f5186e6-2d35-4ccf-a8b4-749a0a872128',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.664994] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.665451] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.665451] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.665451] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.665667] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.682055] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a45a455-673b-417d-b2f6-be9352c2077e in Status: IN_PROGRESS for 2s [ 1069.766886] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.767048] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.767116] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.767344] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.767486] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.791664] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.792030] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.792155] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.792566] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.792619] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.796372] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.800020] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.800020] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.800020] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.800020] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.811311] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: adac9a54-9bb6-4368-a762-389898a52bd9 in Status: IN_PROGRESS for 2s [ 1069.812421] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 934b2684-b99c-4846-87df-66cbae10f2fc in Status: IN_PROGRESS for 2s [ 1069.821372] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bdcc7a21-dd0d-4296-ac34-a880ea6123e7 in Status: IN_PROGRESS for 2s [ 1070.115425] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9f5186e6-2d35-4ccf-a8b4-749a0a872128: rpc.has_security_group_logging(os_id): False [ 1070.133990] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.134171] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.134349] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.134469] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.170093] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.170521] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.170619] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.170619] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.170847] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.170935] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.171325] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.171544] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.171544] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.171693] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.171776] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.171981] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.176274] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.176408] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.176545] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.176637] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.176739] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9f5186e6-2d35-4ccf-a8b4-749a0a872128 is going to be updated. [ 1070.263254] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.263503] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.263622] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.263933] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.264197] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.293924] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9f5186e6-2d35-4ccf-a8b4-749a0a872128 in Status: IN_PROGRESS for 2s [ 1071.538396] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3e5e65a3-941b-4419-9265-0dce9e80179e in Status: SUCCESS [ 1071.538712] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3e5e65a3-941b-4419-9265-0dce9e80179e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.697082] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a45a455-673b-417d-b2f6-be9352c2077e in Status: SUCCESS [ 1071.698178] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a45a455-673b-417d-b2f6-be9352c2077e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.698928] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a45a455-673b-417d-b2f6-be9352c2077e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.699383] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a45a455-673b-417d-b2f6-be9352c2077e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.700103] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.700234] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.700306] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.700471] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.700721] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.700721] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a45a455-673b-417d-b2f6-be9352c2077e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.700721] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5a45a455-673b-417d-b2f6-be9352c2077e',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.831040] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: adac9a54-9bb6-4368-a762-389898a52bd9 in Status: SUCCESS [ 1071.831216] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-adac9a54-9bb6-4368-a762-389898a52bd9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.831942] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 934b2684-b99c-4846-87df-66cbae10f2fc in Status: SUCCESS [ 1071.832127] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-934b2684-b99c-4846-87df-66cbae10f2fc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.835787] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bdcc7a21-dd0d-4296-ac34-a880ea6123e7 in Status: SUCCESS [ 1071.835968] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.207647] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a45a455-673b-417d-b2f6-be9352c2077e taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.207647] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a45a455-673b-417d-b2f6-be9352c2077e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.207647] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a45a455-673b-417d-b2f6-be9352c2077e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.207647] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a45a455-673b-417d-b2f6-be9352c2077e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.207647] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.207647] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.207647] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.207647] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.207647] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.207647] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a45a455-673b-417d-b2f6-be9352c2077e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.207647] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a45a455-673b-417d-b2f6-be9352c2077e taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.207647] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a45a455-673b-417d-b2f6-be9352c2077e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.207647] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a45a455-673b-417d-b2f6-be9352c2077e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.207647] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a45a455-673b-417d-b2f6-be9352c2077e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.207647] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.207647] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.208237] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.208237] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.208237] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.208237] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a45a455-673b-417d-b2f6-be9352c2077e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.208237] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5a45a455-673b-417d-b2f6-be9352c2077e',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.321148] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9f5186e6-2d35-4ccf-a8b4-749a0a872128 in Status: SUCCESS [ 1072.325608] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.325608] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.325608] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.325608] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9f5186e6-2d35-4ccf-a8b4-749a0a872128',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.632708] env[69232]: INFO networking_nsxv3.common.synchronization [None req-efeab897-b162-4120-acbd-d308f246c0b8 None None] Enqueued Resource ID: e6ecfa38-ca3b-40e1-91df-4ee296872fce with Priority: HIGHEST for action port [ 1072.633584] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6ecfa38-ca3b-40e1-91df-4ee296872fce with Priority: HIGHEST for action port [ 1072.633965] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-e6ecfa38-ca3b-40e1-91df-4ee296872fce taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.634166] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e6ecfa38-ca3b-40e1-91df-4ee296872fce" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.634256] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e6ecfa38-ca3b-40e1-91df-4ee296872fce" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.634768] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e6ecfa38-ca3b-40e1-91df-4ee296872fce" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.634876] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e6ecfa38-ca3b-40e1-91df-4ee296872fce',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.709637] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5a45a455-673b-417d-b2f6-be9352c2077e: rpc.has_security_group_logging(os_id): False [ 1072.733818] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.734225] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.734225] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.734385] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.757859] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.757859] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.757859] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.757859] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.757859] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.757859] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.757859] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.757859] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.757859] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.757859] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.757859] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.757859] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.757859] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.757859] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.758384] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.758384] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.758384] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5a45a455-673b-417d-b2f6-be9352c2077e is going to be updated. [ 1072.819422] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.819580] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.819655] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.819882] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.820044] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.827912] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f5186e6-2d35-4ccf-a8b4-749a0a872128 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.828070] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.828132] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.828355] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.828537] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.828645] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.828712] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.828869] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.828966] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.829063] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.829158] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9f5186e6-2d35-4ccf-a8b4-749a0a872128',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.835137] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5a45a455-673b-417d-b2f6-be9352c2077e in Status: IN_PROGRESS for 2s [ 1073.140806] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e6ecfa38-ca3b-40e1-91df-4ee296872fce [ 1073.141130] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.141292] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.141359] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.141935] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.141935] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.141935] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e6ecfa38-ca3b-40e1-91df-4ee296872fce already deleted. [ 1073.141935] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e6ecfa38-ca3b-40e1-91df-4ee296872fce" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.331798] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f5186e6-2d35-4ccf-a8b4-749a0a872128 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.331958] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.332027] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.333346] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.333533] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.333635] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.333700] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.333861] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.333949] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.334041] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.334206] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f5186e6-2d35-4ccf-a8b4-749a0a872128 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.334289] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.334632] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.334788] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.334930] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.335027] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.335092] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.335233] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.335307] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.335382] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.335468] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9f5186e6-2d35-4ccf-a8b4-749a0a872128',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.838356] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9f5186e6-2d35-4ccf-a8b4-749a0a872128: rpc.has_security_group_logging(os_id): False [ 1073.861667] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.861667] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.861667] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.861667] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.861667] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.861667] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.861667] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.861667] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.861667] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.861667] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.861667] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.861667] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.861667] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.861667] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.861667] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.863371] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.863371] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.863371] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.863371] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.863371] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.863371] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9f5186e6-2d35-4ccf-a8b4-749a0a872128 is going to be updated. [ 1073.929065] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.929221] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.929317] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.929571] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.929730] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.945248] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9f5186e6-2d35-4ccf-a8b4-749a0a872128 in Status: IN_PROGRESS for 2s [ 1074.256436] env[69232]: INFO networking_nsxv3.common.synchronization [req-c1357b44-3b29-442a-a79b-f94010d78e5d req-69375046-42de-459f-8c43-221c5c35dae6 tempest-ServerActionsTestOtherA-781098598 tempest-ServerActionsTestOtherA-781098598-project-member] Enqueued Resource ID: 6544a871-f802-46ae-a314-241911fc9dda with Priority: HIGHEST for action security_group_members [ 1074.257163] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6544a871-f802-46ae-a314-241911fc9dda with Priority: HIGHEST for action security_group_members [ 1074.257594] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-6544a871-f802-46ae-a314-241911fc9dda taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.257729] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6544a871-f802-46ae-a314-241911fc9dda" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.258360] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6544a871-f802-46ae-a314-241911fc9dda" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.258698] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6544a871-f802-46ae-a314-241911fc9dda" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.259208] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.259208] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.259208] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.259348] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.259348] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.259448] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6544a871-f802-46ae-a314-241911fc9dda',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.767025] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.767025] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.767025] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.767025] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.767025] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.767025] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.767025] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.767025] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.767025] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.767025] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.767025] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6544a871-f802-46ae-a314-241911fc9dda already deleted. [ 1074.767025] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6544a871-f802-46ae-a314-241911fc9dda" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.850277] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5a45a455-673b-417d-b2f6-be9352c2077e in Status: SUCCESS [ 1074.850277] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5a45a455-673b-417d-b2f6-be9352c2077e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.108134] env[69232]: INFO networking_nsxv3.common.synchronization [None req-8c986d3e-2f10-4a61-8bb9-962009c09c6b None None] Enqueued Resource ID: 6637f93a-7a79-415d-93d0-3f35d5e74aa3 with Priority: HIGHEST for action port [ 1075.108396] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6637f93a-7a79-415d-93d0-3f35d5e74aa3 with Priority: HIGHEST for action port [ 1075.108970] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-6637f93a-7a79-415d-93d0-3f35d5e74aa3 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.109216] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6637f93a-7a79-415d-93d0-3f35d5e74aa3" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.109216] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6637f93a-7a79-415d-93d0-3f35d5e74aa3" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.109466] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6637f93a-7a79-415d-93d0-3f35d5e74aa3" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.110041] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6637f93a-7a79-415d-93d0-3f35d5e74aa3',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.225073] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock network-421 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.225155] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "network-421" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.225278] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "network-421" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.225733] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "network-421" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.225848] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.226018] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.227552] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.227830] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.228008] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.228248] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1075.228372] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] NeedRegenerationException {{(pid=69232) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1075.228494] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] no value, waiting for create lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1075.228639] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] value creation lock acquired {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1075.228761] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1075.228876] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Calling creation function for not-yet-present value {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1075.229025] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1075.252392] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1075.252593] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=69232) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1075.252741] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Released creation lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1075.253780] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "network-421" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.253894] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock port-3c9b4e68-b1c0-4fd7-9d05-33eb7872047f taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.253984] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "port-3c9b4e68-b1c0-4fd7-9d05-33eb7872047f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.254161] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "port-3c9b4e68-b1c0-4fd7-9d05-33eb7872047f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.254510] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "port-3c9b4e68-b1c0-4fd7-9d05-33eb7872047f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.254657] env[69232]: DEBUG networking_nsxv3.api.rpc [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3c9b4e68-b1c0-4fd7-9d05-33eb7872047f',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.368273] env[69232]: INFO networking_nsxv3.common.synchronization [None req-e68e5be0-99bb-4648-9d0d-74ffc862d3dd None None] Enqueued Resource ID: 97e05d2e-f262-4821-9dcd-b1189763281e with Priority: HIGHEST for action port [ 1075.368636] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 97e05d2e-f262-4821-9dcd-b1189763281e with Priority: HIGHEST for action port [ 1075.368899] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-97e05d2e-f262-4821-9dcd-b1189763281e taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.371831] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-97e05d2e-f262-4821-9dcd-b1189763281e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.371831] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-97e05d2e-f262-4821-9dcd-b1189763281e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.371831] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-97e05d2e-f262-4821-9dcd-b1189763281e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.371831] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('97e05d2e-f262-4821-9dcd-b1189763281e',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.617166] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6637f93a-7a79-415d-93d0-3f35d5e74aa3 [ 1075.617166] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.617166] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.617166] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.617166] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.617166] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.617166] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6637f93a-7a79-415d-93d0-3f35d5e74aa3 already deleted. [ 1075.617166] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6637f93a-7a79-415d-93d0-3f35d5e74aa3" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.761327] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.761327] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.761327] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.761327] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.761327] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.761327] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Segment Port 3c9b4e68-b1c0-4fd7-9d05-33eb7872047f not found, creating... [ 1075.761327] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.761569] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.761631] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.761858] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.761995] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.762334] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.763149] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.763395] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.763653] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.763799] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.763948] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Resource: SegmentPort with ID: 3c9b4e68-b1c0-4fd7-9d05-33eb7872047f is going to be created. [ 1075.786075] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.786405] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.786593] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.786875] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.787134] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.787372] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "port-3c9b4e68-b1c0-4fd7-9d05-33eb7872047f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.872465] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 97e05d2e-f262-4821-9dcd-b1189763281e [ 1075.872724] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.872835] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.872916] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.873317] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.873442] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.873553] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:97e05d2e-f262-4821-9dcd-b1189763281e already deleted. [ 1075.873639] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-97e05d2e-f262-4821-9dcd-b1189763281e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.959144] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9f5186e6-2d35-4ccf-a8b4-749a0a872128 in Status: SUCCESS [ 1075.959381] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.718833] env[69232]: INFO networking_nsxv3.common.synchronization [req-b526ade9-863a-4ca1-8002-7634fed9b1b7 req-0d6e885d-0e40-4a53-b8bc-6fcf9395d1ce tempest-AttachVolumeShelveTestJSON-303748050 tempest-AttachVolumeShelveTestJSON-303748050-project-member] Enqueued Resource ID: 5aeb42e6-43fc-4b3e-96b5-dc4a9cddb10c with Priority: HIGHEST for action security_group_members [ 1076.718833] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5aeb42e6-43fc-4b3e-96b5-dc4a9cddb10c with Priority: HIGHEST for action security_group_members [ 1076.721286] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-5aeb42e6-43fc-4b3e-96b5-dc4a9cddb10c taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.721484] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5aeb42e6-43fc-4b3e-96b5-dc4a9cddb10c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.721591] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5aeb42e6-43fc-4b3e-96b5-dc4a9cddb10c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.721880] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5aeb42e6-43fc-4b3e-96b5-dc4a9cddb10c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.722074] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.722388] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.722388] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.722472] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.722594] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.722693] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5aeb42e6-43fc-4b3e-96b5-dc4a9cddb10c',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.775327] env[69232]: INFO networking_nsxv3.common.synchronization [req-c1357b44-3b29-442a-a79b-f94010d78e5d req-d2aaf3d2-92d9-42a1-b49c-5c290a228d28 service nova] Enqueued Resource ID: 6544a871-f802-46ae-a314-241911fc9dda with Priority: HIGHEST for action security_group_rules [ 1076.775327] env[69232]: INFO networking_nsxv3.common.synchronization [req-c1357b44-3b29-442a-a79b-f94010d78e5d req-d2aaf3d2-92d9-42a1-b49c-5c290a228d28 service nova] Enqueued Resource ID: 6544a871-f802-46ae-a314-241911fc9dda with Priority: HIGHEST for action security_group_members [ 1076.775327] env[69232]: INFO networking_nsxv3.common.synchronization [req-c1357b44-3b29-442a-a79b-f94010d78e5d req-d2aaf3d2-92d9-42a1-b49c-5c290a228d28 service nova] Enqueued Resource ID: 3c9b4e68-b1c0-4fd7-9d05-33eb7872047f with Priority: HIGHEST for action port [ 1076.775845] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6544a871-f802-46ae-a314-241911fc9dda with Priority: HIGHEST for action security_group_rules [ 1076.776058] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6544a871-f802-46ae-a314-241911fc9dda with Priority: HIGHEST for action security_group_members [ 1076.776181] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c9b4e68-b1c0-4fd7-9d05-33eb7872047f with Priority: HIGHEST for action port [ 1076.778806] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6544a871-f802-46ae-a314-241911fc9dda taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.778806] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6544a871-f802-46ae-a314-241911fc9dda" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.778806] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6544a871-f802-46ae-a314-241911fc9dda" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.778806] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6544a871-f802-46ae-a314-241911fc9dda" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.778806] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6544a871-f802-46ae-a314-241911fc9dda',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.778806] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-6544a871-f802-46ae-a314-241911fc9dda taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.778806] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6544a871-f802-46ae-a314-241911fc9dda" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.778806] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6544a871-f802-46ae-a314-241911fc9dda" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.778806] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6544a871-f802-46ae-a314-241911fc9dda" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.778806] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.778806] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.778806] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.778806] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.778806] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.778806] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6544a871-f802-46ae-a314-241911fc9dda',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.780925] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-3c9b4e68-b1c0-4fd7-9d05-33eb7872047f taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.781208] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3c9b4e68-b1c0-4fd7-9d05-33eb7872047f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.781475] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3c9b4e68-b1c0-4fd7-9d05-33eb7872047f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.781893] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3c9b4e68-b1c0-4fd7-9d05-33eb7872047f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.781986] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3c9b4e68-b1c0-4fd7-9d05-33eb7872047f',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.079490] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock network-548 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.079814] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "network-548" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.079960] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "network-548" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.080278] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "network-548" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.080557] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.080756] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.080918] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.081377] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.081570] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.081813] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1077.081960] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] NeedRegenerationException {{(pid=69232) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1077.082108] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] no value, waiting for create lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1077.082242] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] value creation lock acquired {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1077.082367] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1077.082479] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Calling creation function for not-yet-present value {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1077.082644] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1077.106540] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1077.106720] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=69232) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1077.106867] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Released creation lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1077.107068] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "network-548" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.107551] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock port-8f56ac24-8c04-4bbd-b439-c7d0338161ae taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.107752] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "port-8f56ac24-8c04-4bbd-b439-c7d0338161ae" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.107881] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "port-8f56ac24-8c04-4bbd-b439-c7d0338161ae" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.108249] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "port-8f56ac24-8c04-4bbd-b439-c7d0338161ae" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.108451] env[69232]: DEBUG networking_nsxv3.api.rpc [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8f56ac24-8c04-4bbd-b439-c7d0338161ae',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.225725] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.225921] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.225974] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.226214] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.226335] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.226560] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.226665] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.226759] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.226886] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.226963] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.227059] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5aeb42e6-43fc-4b3e-96b5-dc4a9cddb10c already deleted. [ 1077.227141] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5aeb42e6-43fc-4b3e-96b5-dc4a9cddb10c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.283825] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-6544a871-f802-46ae-a314-241911fc9dda taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.283971] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6544a871-f802-46ae-a314-241911fc9dda" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.284270] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3c9b4e68-b1c0-4fd7-9d05-33eb7872047f with status ACTIVE [ 1077.284458] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.284567] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.284640] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.284840] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.284930] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.285121] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.285252] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.285321] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.285500] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.285832] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.286046] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.286140] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.286203] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.286347] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.286424] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.286508] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3c9b4e68-b1c0-4fd7-9d05-33eb7872047f is going to be updated. [ 1077.287879] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6544a871-f802-46ae-a314-241911fc9dda',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.314132] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.314132] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.314132] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.314433] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.314543] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.314700] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3c9b4e68-b1c0-4fd7-9d05-33eb7872047f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.372025] env[69232]: INFO networking_nsxv3.common.synchronization [None req-63bf295c-02d8-4265-8ab0-1a0fd1925131 None None] Enqueued Resource ID: e366b493-5762-4c8b-af04-539a5ddfd2de with Priority: HIGHEST for action port [ 1077.372025] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e366b493-5762-4c8b-af04-539a5ddfd2de with Priority: HIGHEST for action port [ 1077.372025] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-e366b493-5762-4c8b-af04-539a5ddfd2de taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.372025] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e366b493-5762-4c8b-af04-539a5ddfd2de" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.372025] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e366b493-5762-4c8b-af04-539a5ddfd2de" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.372025] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e366b493-5762-4c8b-af04-539a5ddfd2de" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.372025] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e366b493-5762-4c8b-af04-539a5ddfd2de',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.556038] env[69232]: INFO networking_nsxv3.common.synchronization [req-610bd238-7ca5-44a0-8b74-2d2bf84d4454 req-e79e9bd2-235e-436b-94c8-8269733a0b1e tempest-AttachVolumeNegativeTest-731570695 tempest-AttachVolumeNegativeTest-731570695-project-member] Enqueued Resource ID: 8e5c2d57-e29a-48c5-977d-f19d1fe77c00 with Priority: HIGHEST for action security_group_members [ 1077.556038] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e5c2d57-e29a-48c5-977d-f19d1fe77c00 with Priority: HIGHEST for action security_group_members [ 1077.556272] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-8e5c2d57-e29a-48c5-977d-f19d1fe77c00 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.556272] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8e5c2d57-e29a-48c5-977d-f19d1fe77c00" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.556393] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8e5c2d57-e29a-48c5-977d-f19d1fe77c00" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.558878] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8e5c2d57-e29a-48c5-977d-f19d1fe77c00" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.558878] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.558878] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.558878] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.558878] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.558878] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.558878] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8e5c2d57-e29a-48c5-977d-f19d1fe77c00',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.611656] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.612134] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.612415] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.612805] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.613133] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.613454] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Segment Port 8f56ac24-8c04-4bbd-b439-c7d0338161ae not found, creating... [ 1077.614072] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.614178] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.614264] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.614757] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.614757] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.615348] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.615348] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.615474] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.615725] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.615884] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.616104] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Resource: SegmentPort with ID: 8f56ac24-8c04-4bbd-b439-c7d0338161ae is going to be created. [ 1077.639778] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.640061] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.640201] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.640504] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.644066] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.644066] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "port-8f56ac24-8c04-4bbd-b439-c7d0338161ae" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.790393] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6544a871-f802-46ae-a314-241911fc9dda',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.877407] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e366b493-5762-4c8b-af04-539a5ddfd2de [ 1077.878525] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.878525] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.878688] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.878782] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.881586] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.881586] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e366b493-5762-4c8b-af04-539a5ddfd2de already deleted. [ 1077.881586] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e366b493-5762-4c8b-af04-539a5ddfd2de" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.063394] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.063394] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.063394] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.063394] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.087512] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.087512] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.087512] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.087512] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.087512] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.087512] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.087512] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8e5c2d57-e29a-48c5-977d-f19d1fe77c00 is going to be updated. [ 1078.115807] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.115949] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.115990] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.116706] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.116706] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.129922] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8e5c2d57-e29a-48c5-977d-f19d1fe77c00 in Status: IN_PROGRESS for 2s [ 1078.297024] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.297024] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.297024] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.297024] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.297024] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.297024] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6544a871-f802-46ae-a314-241911fc9dda is going to be created. [ 1078.324202] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.324340] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.324415] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.324623] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.324782] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.337532] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6544a871-f802-46ae-a314-241911fc9dda in Status: UNINITIALIZED for 2s [ 1078.362026] env[69232]: INFO networking_nsxv3.common.synchronization [None req-86849a2b-ecd6-4960-8c35-44f7e3704034 None None] Enqueued Resource ID: e1494d8e-572b-4a99-ab11-6caf53cdea3a with Priority: HIGHEST for action port [ 1078.362026] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e1494d8e-572b-4a99-ab11-6caf53cdea3a with Priority: HIGHEST for action port [ 1078.362026] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-e1494d8e-572b-4a99-ab11-6caf53cdea3a taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.362026] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e1494d8e-572b-4a99-ab11-6caf53cdea3a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.362538] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e1494d8e-572b-4a99-ab11-6caf53cdea3a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.362538] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e1494d8e-572b-4a99-ab11-6caf53cdea3a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.362538] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e1494d8e-572b-4a99-ab11-6caf53cdea3a',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.602452] env[69232]: INFO networking_nsxv3.common.synchronization [req-b526ade9-863a-4ca1-8002-7634fed9b1b7 req-1a263f1c-08d2-4d66-b4b6-3e973ef9b83a service nova] Enqueued Resource ID: 5aeb42e6-43fc-4b3e-96b5-dc4a9cddb10c with Priority: HIGHEST for action security_group_rules [ 1078.602568] env[69232]: INFO networking_nsxv3.common.synchronization [req-b526ade9-863a-4ca1-8002-7634fed9b1b7 req-1a263f1c-08d2-4d66-b4b6-3e973ef9b83a service nova] Enqueued Resource ID: 5aeb42e6-43fc-4b3e-96b5-dc4a9cddb10c with Priority: HIGHEST for action security_group_members [ 1078.602870] env[69232]: INFO networking_nsxv3.common.synchronization [req-b526ade9-863a-4ca1-8002-7634fed9b1b7 req-1a263f1c-08d2-4d66-b4b6-3e973ef9b83a service nova] Enqueued Resource ID: 8f56ac24-8c04-4bbd-b439-c7d0338161ae with Priority: HIGHEST for action port [ 1078.603578] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5aeb42e6-43fc-4b3e-96b5-dc4a9cddb10c with Priority: HIGHEST for action security_group_rules [ 1078.603578] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5aeb42e6-43fc-4b3e-96b5-dc4a9cddb10c with Priority: HIGHEST for action security_group_members [ 1078.603578] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f56ac24-8c04-4bbd-b439-c7d0338161ae with Priority: HIGHEST for action port [ 1078.604229] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5aeb42e6-43fc-4b3e-96b5-dc4a9cddb10c taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.604401] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5aeb42e6-43fc-4b3e-96b5-dc4a9cddb10c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.604463] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5aeb42e6-43fc-4b3e-96b5-dc4a9cddb10c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.604671] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5aeb42e6-43fc-4b3e-96b5-dc4a9cddb10c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.604797] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5aeb42e6-43fc-4b3e-96b5-dc4a9cddb10c',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.606274] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-5aeb42e6-43fc-4b3e-96b5-dc4a9cddb10c taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.606373] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5aeb42e6-43fc-4b3e-96b5-dc4a9cddb10c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.606439] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5aeb42e6-43fc-4b3e-96b5-dc4a9cddb10c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.606636] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5aeb42e6-43fc-4b3e-96b5-dc4a9cddb10c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.606823] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.606880] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.606949] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.607540] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.607744] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.607744] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5aeb42e6-43fc-4b3e-96b5-dc4a9cddb10c',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.608778] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-8f56ac24-8c04-4bbd-b439-c7d0338161ae taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.608972] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8f56ac24-8c04-4bbd-b439-c7d0338161ae" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.609093] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8f56ac24-8c04-4bbd-b439-c7d0338161ae" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.609310] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8f56ac24-8c04-4bbd-b439-c7d0338161ae" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.609440] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8f56ac24-8c04-4bbd-b439-c7d0338161ae',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.866199] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e1494d8e-572b-4a99-ab11-6caf53cdea3a [ 1078.866501] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.866615] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.866658] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.867017] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.867017] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.867118] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e1494d8e-572b-4a99-ab11-6caf53cdea3a already deleted. [ 1078.867118] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e1494d8e-572b-4a99-ab11-6caf53cdea3a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.111806] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-5aeb42e6-43fc-4b3e-96b5-dc4a9cddb10c taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.112440] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5aeb42e6-43fc-4b3e-96b5-dc4a9cddb10c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.112440] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5aeb42e6-43fc-4b3e-96b5-dc4a9cddb10c',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.113643] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8f56ac24-8c04-4bbd-b439-c7d0338161ae with status ACTIVE [ 1079.113643] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.113643] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.113643] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.113866] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.113866] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.113922] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.114037] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.114101] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.114280] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.117579] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.117715] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.119593] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.119593] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.119593] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.119593] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.119593] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8f56ac24-8c04-4bbd-b439-c7d0338161ae is going to be updated. [ 1079.169940] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.170122] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.170194] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.170406] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.172151] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.173456] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8f56ac24-8c04-4bbd-b439-c7d0338161ae" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.620306] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5aeb42e6-43fc-4b3e-96b5-dc4a9cddb10c',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.059578] env[69232]: INFO networking_nsxv3.common.synchronization [req-f255f708-24b7-4283-b1d6-9bf056c820dc req-737a7f2d-39d3-4e8c-bf71-289a007ac39a tempest-DeleteServersTestJSON-830271628 tempest-DeleteServersTestJSON-830271628-project-member] Enqueued Resource ID: 9f5186e6-2d35-4ccf-a8b4-749a0a872128 with Priority: HIGHEST for action security_group_members [ 1080.060114] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f5186e6-2d35-4ccf-a8b4-749a0a872128 with Priority: HIGHEST for action security_group_members [ 1080.060588] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f5186e6-2d35-4ccf-a8b4-749a0a872128 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.060588] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.060728] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.061245] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.061665] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.062067] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.062067] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.062067] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.062236] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.062236] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9f5186e6-2d35-4ccf-a8b4-749a0a872128',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.122752] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.123179] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.123179] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.123291] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.123369] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.123468] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5aeb42e6-43fc-4b3e-96b5-dc4a9cddb10c is going to be created. [ 1080.135565] env[69232]: INFO networking_nsxv3.common.synchronization [req-8f542037-5d5d-4b07-b452-dc3296a7a01e req-ece1fbb4-22e2-461a-8388-cb33075f630b tempest-ServersTestJSON-524901877 tempest-ServersTestJSON-524901877-project-member] Enqueued Resource ID: bdcc7a21-dd0d-4296-ac34-a880ea6123e7 with Priority: HIGHEST for action security_group_members [ 1080.136116] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdcc7a21-dd0d-4296-ac34-a880ea6123e7 with Priority: HIGHEST for action security_group_members [ 1080.136421] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.136545] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.136613] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.136808] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.136951] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.137333] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.137429] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.137606] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.137696] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.137817] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bdcc7a21-dd0d-4296-ac34-a880ea6123e7',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.140566] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8e5c2d57-e29a-48c5-977d-f19d1fe77c00 in Status: SUCCESS [ 1080.140775] env[69232]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8e5c2d57-e29a-48c5-977d-f19d1fe77c00 deletion is rescheduled due to dependency. [ 1080.140881] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8e5c2d57-e29a-48c5-977d-f19d1fe77c00" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.152383] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.152383] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.152383] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.152383] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.152844] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.163995] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5aeb42e6-43fc-4b3e-96b5-dc4a9cddb10c in Status: UNINITIALIZED for 2s [ 1080.346128] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6544a871-f802-46ae-a314-241911fc9dda in Status: SUCCESS [ 1080.346923] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6544a871-f802-46ae-a314-241911fc9dda" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.346923] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6544a871-f802-46ae-a314-241911fc9dda" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.346923] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6544a871-f802-46ae-a314-241911fc9dda" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.346923] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.346923] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.346923] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.347177] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.347350] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.347350] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6544a871-f802-46ae-a314-241911fc9dda" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.347447] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6544a871-f802-46ae-a314-241911fc9dda',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.564860] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.565166] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.565241] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.565571] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.565700] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.566016] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.566166] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.566262] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.566482] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.566621] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.566749] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9f5186e6-2d35-4ccf-a8b4-749a0a872128 is going to be updated. [ 1080.625384] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.625384] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.625384] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.625384] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.625690] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.644449] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bdcc7a21-dd0d-4296-ac34-a880ea6123e7',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.646104] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f5186e6-2d35-4ccf-a8b4-749a0a872128 in Status: IN_PROGRESS for 2s [ 1080.778950] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock network-738 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.779177] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "network-738" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.779311] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "network-738" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.783022] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "network-738" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.783022] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.783022] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.783022] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.783022] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.783022] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.783022] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1080.783022] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] NeedRegenerationException {{(pid=69232) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1080.783022] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] no value, waiting for create lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1080.783022] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] value creation lock acquired {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1080.783022] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1080.783022] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Calling creation function for not-yet-present value {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1080.783022] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1080.802908] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1080.803542] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69232) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1080.803707] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Released creation lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1080.803930] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "network-738" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.804377] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock port-eb819a84-f0ae-40ca-95b9-eafa4c82fedd taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.804532] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "port-eb819a84-f0ae-40ca-95b9-eafa4c82fedd" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.804701] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "port-eb819a84-f0ae-40ca-95b9-eafa4c82fedd" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.805315] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "port-eb819a84-f0ae-40ca-95b9-eafa4c82fedd" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.805576] env[69232]: DEBUG networking_nsxv3.api.rpc [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eb819a84-f0ae-40ca-95b9-eafa4c82fedd',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.819905] env[69232]: INFO networking_nsxv3.common.synchronization [None req-8a11f826-525c-4b99-86b3-ca77675c6c8b None None] Enqueued Resource ID: 939bf44b-91ee-4572-ab97-b0c05f537aba with Priority: HIGHEST for action port [ 1080.819905] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 939bf44b-91ee-4572-ab97-b0c05f537aba with Priority: HIGHEST for action port [ 1080.820358] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-939bf44b-91ee-4572-ab97-b0c05f537aba taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.820456] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-939bf44b-91ee-4572-ab97-b0c05f537aba" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.820456] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-939bf44b-91ee-4572-ab97-b0c05f537aba" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.820709] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-939bf44b-91ee-4572-ab97-b0c05f537aba" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.820790] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('939bf44b-91ee-4572-ab97-b0c05f537aba',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.850799] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6544a871-f802-46ae-a314-241911fc9dda',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.147132] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bdcc7a21-dd0d-4296-ac34-a880ea6123e7',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.308952] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.309368] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.309602] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.309983] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.310284] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.310530] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Segment Port eb819a84-f0ae-40ca-95b9-eafa4c82fedd not found, creating... [ 1081.311108] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.311108] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.311328] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.311562] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.311705] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.312232] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.312455] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.312638] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.312931] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.313194] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.313401] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Resource: SegmentPort with ID: eb819a84-f0ae-40ca-95b9-eafa4c82fedd is going to be created. [ 1081.322691] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 939bf44b-91ee-4572-ab97-b0c05f537aba [ 1081.323018] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.323246] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.323375] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.323652] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.323785] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.323927] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:939bf44b-91ee-4572-ab97-b0c05f537aba already deleted. [ 1081.324084] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-939bf44b-91ee-4572-ab97-b0c05f537aba" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.334057] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.334355] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.334497] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.334759] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.334990] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.335237] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "port-eb819a84-f0ae-40ca-95b9-eafa4c82fedd" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.352710] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6544a871-f802-46ae-a314-241911fc9dda: rpc.has_security_group_logging(os_id): False [ 1081.372017] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.372017] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.372017] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.372017] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.372017] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.372017] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.372017] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.372017] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.372017] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.372017] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.372017] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6544a871-f802-46ae-a314-241911fc9dda is going to be created. [ 1081.462817] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.462976] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.463084] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.463364] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.463564] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.483711] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6544a871-f802-46ae-a314-241911fc9dda in Status: IN_PROGRESS for 2s [ 1081.650854] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.651249] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.651519] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.651928] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.652728] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.652983] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bdcc7a21-dd0d-4296-ac34-a880ea6123e7 is going to be updated. [ 1081.692571] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.692571] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.692571] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.692571] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.692571] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.701952] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bdcc7a21-dd0d-4296-ac34-a880ea6123e7 in Status: IN_PROGRESS for 2s [ 1082.187450] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5aeb42e6-43fc-4b3e-96b5-dc4a9cddb10c in Status: SUCCESS [ 1082.187829] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5aeb42e6-43fc-4b3e-96b5-dc4a9cddb10c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.187952] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5aeb42e6-43fc-4b3e-96b5-dc4a9cddb10c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.188182] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5aeb42e6-43fc-4b3e-96b5-dc4a9cddb10c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.188415] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.188610] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.188610] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.188849] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.188977] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.189124] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5aeb42e6-43fc-4b3e-96b5-dc4a9cddb10c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.189257] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5aeb42e6-43fc-4b3e-96b5-dc4a9cddb10c',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.367198] env[69232]: INFO networking_nsxv3.common.synchronization [req-8f542037-5d5d-4b07-b452-dc3296a7a01e req-70db2865-a444-42cc-bfbc-294b23798e2c service nova] Enqueued Resource ID: bdcc7a21-dd0d-4296-ac34-a880ea6123e7 with Priority: HIGHEST for action security_group_rules [ 1082.367375] env[69232]: INFO networking_nsxv3.common.synchronization [req-8f542037-5d5d-4b07-b452-dc3296a7a01e req-70db2865-a444-42cc-bfbc-294b23798e2c service nova] Enqueued Resource ID: bdcc7a21-dd0d-4296-ac34-a880ea6123e7 with Priority: HIGHEST for action security_group_members [ 1082.367513] env[69232]: INFO networking_nsxv3.common.synchronization [req-8f542037-5d5d-4b07-b452-dc3296a7a01e req-70db2865-a444-42cc-bfbc-294b23798e2c service nova] Enqueued Resource ID: eb819a84-f0ae-40ca-95b9-eafa4c82fedd with Priority: HIGHEST for action port [ 1082.367740] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdcc7a21-dd0d-4296-ac34-a880ea6123e7 with Priority: HIGHEST for action security_group_rules [ 1082.367864] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdcc7a21-dd0d-4296-ac34-a880ea6123e7 with Priority: HIGHEST for action security_group_members [ 1082.367954] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb819a84-f0ae-40ca-95b9-eafa4c82fedd with Priority: HIGHEST for action port [ 1082.368515] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bdcc7a21-dd0d-4296-ac34-a880ea6123e7 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.368630] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.371122] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.371122] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.371122] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bdcc7a21-dd0d-4296-ac34-a880ea6123e7',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.371122] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.371122] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.371122] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-eb819a84-f0ae-40ca-95b9-eafa4c82fedd taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.371122] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-eb819a84-f0ae-40ca-95b9-eafa4c82fedd" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.371122] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-eb819a84-f0ae-40ca-95b9-eafa4c82fedd" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.371122] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-eb819a84-f0ae-40ca-95b9-eafa4c82fedd" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.371122] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eb819a84-f0ae-40ca-95b9-eafa4c82fedd',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.403851] env[69232]: INFO networking_nsxv3.common.synchronization [req-def146ab-f95a-4fa8-b2ac-2a6223373d3d req-cbd1ddec-1694-4311-9e5b-925419cd6502 tempest-MultipleCreateTestJSON-2129230941 tempest-MultipleCreateTestJSON-2129230941-project-member] Enqueued Resource ID: be581393-4638-4971-8e7f-56047ad132ae with Priority: HIGHEST for action security_group_members [ 1082.404396] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: be581393-4638-4971-8e7f-56047ad132ae with Priority: HIGHEST for action security_group_members [ 1082.404712] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-be581393-4638-4971-8e7f-56047ad132ae taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.404826] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-be581393-4638-4971-8e7f-56047ad132ae" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.406031] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-be581393-4638-4971-8e7f-56047ad132ae" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.407124] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-be581393-4638-4971-8e7f-56047ad132ae" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.407124] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.407261] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.407299] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.407466] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.407550] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.407642] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('be581393-4638-4971-8e7f-56047ad132ae',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.659218] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f5186e6-2d35-4ccf-a8b4-749a0a872128 in Status: SUCCESS [ 1082.659218] env[69232]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9f5186e6-2d35-4ccf-a8b4-749a0a872128 deletion is rescheduled due to dependency. [ 1082.659218] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.692239] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5aeb42e6-43fc-4b3e-96b5-dc4a9cddb10c',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.739503] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock network-644 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.739503] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "network-644" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.739627] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "network-644" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.740186] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "network-644" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.741133] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.741133] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.741133] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.741538] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.742706] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.742706] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1082.742706] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] NeedRegenerationException {{(pid=69232) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1082.742706] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] no value, waiting for create lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1082.742878] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] value creation lock acquired {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1082.742878] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1082.742954] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Calling creation function for not-yet-present value {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1082.743231] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1082.764049] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1082.764369] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69232) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1082.764959] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Released creation lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1082.765246] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "network-644" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.765649] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock port-47201786-7b08-4b35-bbe2-02dee3e01e76 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.766619] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "port-47201786-7b08-4b35-bbe2-02dee3e01e76" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.766830] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "port-47201786-7b08-4b35-bbe2-02dee3e01e76" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.767253] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "port-47201786-7b08-4b35-bbe2-02dee3e01e76" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.767637] env[69232]: DEBUG networking_nsxv3.api.rpc [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('47201786-7b08-4b35-bbe2-02dee3e01e76',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.874604] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.874604] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.874604] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port eb819a84-f0ae-40ca-95b9-eafa4c82fedd with status ACTIVE [ 1082.874604] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.874604] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.874604] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.874604] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.874604] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.874604] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.874604] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.874604] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.874604] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.874604] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.875317] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.875317] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.875317] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.875317] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.875317] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.875317] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: eb819a84-f0ae-40ca-95b9-eafa4c82fedd is going to be updated. [ 1082.903945] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.904186] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.904186] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.904412] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.904575] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.904752] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-eb819a84-f0ae-40ca-95b9-eafa4c82fedd" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.909362] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.909487] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.909554] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.909769] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.932603] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.932863] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.932989] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.933070] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.933315] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.933452] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.933527] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: be581393-4638-4971-8e7f-56047ad132ae is going to be updated. [ 1082.960678] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.961027] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.961027] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.961278] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.961477] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.972289] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: be581393-4638-4971-8e7f-56047ad132ae in Status: IN_PROGRESS for 2s [ 1083.195138] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5aeb42e6-43fc-4b3e-96b5-dc4a9cddb10c: rpc.has_security_group_logging(os_id): False [ 1083.221609] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.221910] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.221910] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.222153] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.222294] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.222658] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.222805] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.222805] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.223115] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.223115] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.223331] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5aeb42e6-43fc-4b3e-96b5-dc4a9cddb10c is going to be created. [ 1083.275075] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.275347] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.275490] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.275906] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.276223] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.276390] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Segment Port 47201786-7b08-4b35-bbe2-02dee3e01e76 not found, creating... [ 1083.276823] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.277111] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.277324] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.277754] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.278024] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.278697] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.278847] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.279071] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.279416] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.279586] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.279739] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Resource: SegmentPort with ID: 47201786-7b08-4b35-bbe2-02dee3e01e76 is going to be created. [ 1083.299334] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.299527] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.299566] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.299756] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.299977] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.321334] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.321584] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.321668] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.322085] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.322464] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.322832] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "port-47201786-7b08-4b35-bbe2-02dee3e01e76" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.324584] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5aeb42e6-43fc-4b3e-96b5-dc4a9cddb10c in Status: IN_PROGRESS for 2s [ 1083.506076] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6544a871-f802-46ae-a314-241911fc9dda in Status: SUCCESS [ 1083.506432] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6544a871-f802-46ae-a314-241911fc9dda" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.712144] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bdcc7a21-dd0d-4296-ac34-a880ea6123e7 in Status: SUCCESS [ 1083.716052] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.716052] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.716052] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.716052] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.716052] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.716052] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.716052] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.716052] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.716052] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bdcc7a21-dd0d-4296-ac34-a880ea6123e7',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.002471] env[69232]: INFO networking_nsxv3.common.synchronization [req-def146ab-f95a-4fa8-b2ac-2a6223373d3d req-8f38a532-a6dc-4f23-8ff1-9688d4c0d43d service nova] Enqueued Resource ID: be581393-4638-4971-8e7f-56047ad132ae with Priority: HIGHEST for action security_group_rules [ 1084.002471] env[69232]: INFO networking_nsxv3.common.synchronization [req-def146ab-f95a-4fa8-b2ac-2a6223373d3d req-8f38a532-a6dc-4f23-8ff1-9688d4c0d43d service nova] Enqueued Resource ID: be581393-4638-4971-8e7f-56047ad132ae with Priority: HIGHEST for action security_group_members [ 1084.002471] env[69232]: INFO networking_nsxv3.common.synchronization [req-def146ab-f95a-4fa8-b2ac-2a6223373d3d req-8f38a532-a6dc-4f23-8ff1-9688d4c0d43d service nova] Enqueued Resource ID: 47201786-7b08-4b35-bbe2-02dee3e01e76 with Priority: HIGHEST for action port [ 1084.002471] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: be581393-4638-4971-8e7f-56047ad132ae with Priority: HIGHEST for action security_group_rules [ 1084.002864] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: be581393-4638-4971-8e7f-56047ad132ae with Priority: HIGHEST for action security_group_members [ 1084.002864] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47201786-7b08-4b35-bbe2-02dee3e01e76 with Priority: HIGHEST for action port [ 1084.005256] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-be581393-4638-4971-8e7f-56047ad132ae taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.005256] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-be581393-4638-4971-8e7f-56047ad132ae" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.005256] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-be581393-4638-4971-8e7f-56047ad132ae" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.005677] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-be581393-4638-4971-8e7f-56047ad132ae" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.005677] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('be581393-4638-4971-8e7f-56047ad132ae',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.006968] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-be581393-4638-4971-8e7f-56047ad132ae taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.007148] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-be581393-4638-4971-8e7f-56047ad132ae" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.007440] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-47201786-7b08-4b35-bbe2-02dee3e01e76 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.007591] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-47201786-7b08-4b35-bbe2-02dee3e01e76" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.007678] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-47201786-7b08-4b35-bbe2-02dee3e01e76" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.007883] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-47201786-7b08-4b35-bbe2-02dee3e01e76" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.007987] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('47201786-7b08-4b35-bbe2-02dee3e01e76',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.215915] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bdcc7a21-dd0d-4296-ac34-a880ea6123e7',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.510058] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-be581393-4638-4971-8e7f-56047ad132ae taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.510603] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-be581393-4638-4971-8e7f-56047ad132ae" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.511710] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 47201786-7b08-4b35-bbe2-02dee3e01e76 with status ACTIVE [ 1084.512030] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.512182] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.512302] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.512608] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.512764] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.513346] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.513463] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.513578] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.513835] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.513996] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.515661] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.515661] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.515661] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.515661] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.515661] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.515661] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 47201786-7b08-4b35-bbe2-02dee3e01e76 is going to be updated. [ 1084.528856] env[69232]: INFO networking_nsxv3.common.synchronization [req-5d3eccb2-7d00-4ca0-806d-16aee95df8da req-2a8d46db-8538-41fe-9f1a-7022db082983 tempest-ServerDiskConfigTestJSON-1562148127 tempest-ServerDiskConfigTestJSON-1562148127-project-member] Enqueued Resource ID: 5a45a455-673b-417d-b2f6-be9352c2077e with Priority: HIGHEST for action security_group_members [ 1084.529524] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a45a455-673b-417d-b2f6-be9352c2077e with Priority: HIGHEST for action security_group_members [ 1084.529714] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a45a455-673b-417d-b2f6-be9352c2077e taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.529837] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a45a455-673b-417d-b2f6-be9352c2077e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.529904] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a45a455-673b-417d-b2f6-be9352c2077e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.530121] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a45a455-673b-417d-b2f6-be9352c2077e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.530411] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.530411] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.530531] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.530622] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.530798] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.530798] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5a45a455-673b-417d-b2f6-be9352c2077e',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.545178] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.545359] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.545400] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.545729] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.545809] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.546608] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-47201786-7b08-4b35-bbe2-02dee3e01e76" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.718709] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bdcc7a21-dd0d-4296-ac34-a880ea6123e7',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.888464] env[69232]: INFO networking_nsxv3.common.synchronization [req-def146ab-f95a-4fa8-b2ac-2a6223373d3d req-70c19926-f6b8-4037-827f-af452be09ef0 tempest-MultipleCreateTestJSON-2129230941 tempest-MultipleCreateTestJSON-2129230941-project-member] Enqueued Resource ID: be581393-4638-4971-8e7f-56047ad132ae with Priority: HIGHEST for action security_group_members [ 1084.889021] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: be581393-4638-4971-8e7f-56047ad132ae with Priority: HIGHEST for action security_group_members [ 1084.889378] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-be581393-4638-4971-8e7f-56047ad132ae taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.889480] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-be581393-4638-4971-8e7f-56047ad132ae" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.984514] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: be581393-4638-4971-8e7f-56047ad132ae in Status: SUCCESS [ 1084.984719] env[69232]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: be581393-4638-4971-8e7f-56047ad132ae deletion is rescheduled due to dependency. [ 1084.984866] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-be581393-4638-4971-8e7f-56047ad132ae" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.985008] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-be581393-4638-4971-8e7f-56047ad132ae" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.985325] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-be581393-4638-4971-8e7f-56047ad132ae" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.985441] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.985527] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.985626] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.985773] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.985851] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.985947] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('be581393-4638-4971-8e7f-56047ad132ae',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.032603] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.032708] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.032708] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.032914] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.033010] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.033199] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.033327] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.033389] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.033538] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.033628] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.033712] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5a45a455-673b-417d-b2f6-be9352c2077e is going to be updated. [ 1085.062947] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.063371] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.064150] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.064407] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.064577] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.074220] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a45a455-673b-417d-b2f6-be9352c2077e in Status: IN_PROGRESS for 2s [ 1085.201548] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock network-644 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.201781] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "network-644" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.201928] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "network-644" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.202222] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "network-644" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.202521] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.204021] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.204021] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.204021] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.204021] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.204021] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1085.204021] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] NeedRegenerationException {{(pid=69232) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1085.204021] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] no value, waiting for create lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1085.204376] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] value creation lock acquired {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1085.204547] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1085.204740] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Calling creation function for not-yet-present value {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1085.204898] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1085.220081] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.220432] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.220432] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.220573] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.220679] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.220780] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bdcc7a21-dd0d-4296-ac34-a880ea6123e7 is going to be updated. [ 1085.228350] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1085.228402] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69232) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1085.229417] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Released creation lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1085.229417] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "network-644" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.229417] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock port-269cb2cc-fdf0-4134-84c2-af60c805a15d taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.229417] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "port-269cb2cc-fdf0-4134-84c2-af60c805a15d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.229417] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "port-269cb2cc-fdf0-4134-84c2-af60c805a15d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.229725] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "port-269cb2cc-fdf0-4134-84c2-af60c805a15d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.229860] env[69232]: DEBUG networking_nsxv3.api.rpc [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('269cb2cc-fdf0-4134-84c2-af60c805a15d',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.251983] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.252153] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.252259] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.252571] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.252571] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.263455] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bdcc7a21-dd0d-4296-ac34-a880ea6123e7 in Status: IN_PROGRESS for 2s [ 1085.338998] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5aeb42e6-43fc-4b3e-96b5-dc4a9cddb10c in Status: SUCCESS [ 1085.340898] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5aeb42e6-43fc-4b3e-96b5-dc4a9cddb10c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.489418] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('be581393-4638-4971-8e7f-56047ad132ae',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.732741] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.732975] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.733118] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.733507] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.733660] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.733819] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Segment Port 269cb2cc-fdf0-4134-84c2-af60c805a15d not found, creating... [ 1085.734135] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.734361] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.734483] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.734712] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.734851] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.735382] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.735970] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.738306] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.738306] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.738306] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.738306] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Resource: SegmentPort with ID: 269cb2cc-fdf0-4134-84c2-af60c805a15d is going to be created. [ 1085.760501] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.760706] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.760834] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.761138] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.761408] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.761648] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "port-269cb2cc-fdf0-4134-84c2-af60c805a15d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.991195] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('be581393-4638-4971-8e7f-56047ad132ae',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.496980] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.496980] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.496980] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.496980] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.496980] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.496980] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: be581393-4638-4971-8e7f-56047ad132ae is going to be updated. [ 1086.538502] env[69232]: INFO networking_nsxv3.common.synchronization [req-def146ab-f95a-4fa8-b2ac-2a6223373d3d req-599631dd-f9a9-4adb-b5a5-9c7223a54e78 service nova] Enqueued Resource ID: be581393-4638-4971-8e7f-56047ad132ae with Priority: HIGHEST for action security_group_rules [ 1086.538502] env[69232]: INFO networking_nsxv3.common.synchronization [req-def146ab-f95a-4fa8-b2ac-2a6223373d3d req-599631dd-f9a9-4adb-b5a5-9c7223a54e78 service nova] Enqueued Resource ID: be581393-4638-4971-8e7f-56047ad132ae with Priority: HIGHEST for action security_group_members [ 1086.538502] env[69232]: INFO networking_nsxv3.common.synchronization [req-def146ab-f95a-4fa8-b2ac-2a6223373d3d req-599631dd-f9a9-4adb-b5a5-9c7223a54e78 service nova] Enqueued Resource ID: 269cb2cc-fdf0-4134-84c2-af60c805a15d with Priority: HIGHEST for action port [ 1086.538766] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: be581393-4638-4971-8e7f-56047ad132ae with Priority: HIGHEST for action security_group_rules [ 1086.539095] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: be581393-4638-4971-8e7f-56047ad132ae with Priority: HIGHEST for action security_group_members [ 1086.539095] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 269cb2cc-fdf0-4134-84c2-af60c805a15d with Priority: HIGHEST for action port [ 1086.539890] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-be581393-4638-4971-8e7f-56047ad132ae taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.540156] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-be581393-4638-4971-8e7f-56047ad132ae" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.540258] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-be581393-4638-4971-8e7f-56047ad132ae taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.540334] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-be581393-4638-4971-8e7f-56047ad132ae" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.540588] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-269cb2cc-fdf0-4134-84c2-af60c805a15d taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.542169] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-269cb2cc-fdf0-4134-84c2-af60c805a15d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.542169] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-269cb2cc-fdf0-4134-84c2-af60c805a15d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.542169] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-269cb2cc-fdf0-4134-84c2-af60c805a15d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.542169] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('269cb2cc-fdf0-4134-84c2-af60c805a15d',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.548960] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.549601] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.549601] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.549601] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.549744] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.561216] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: be581393-4638-4971-8e7f-56047ad132ae in Status: IN_PROGRESS for 2s [ 1087.042790] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 269cb2cc-fdf0-4134-84c2-af60c805a15d with status ACTIVE [ 1087.043026] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.043160] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.043264] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.043491] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.043591] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.043769] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.043856] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.043915] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.044101] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.044195] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.044438] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.044536] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.044601] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.044773] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.044850] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.044935] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 269cb2cc-fdf0-4134-84c2-af60c805a15d is going to be updated. [ 1087.071146] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.072120] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.072120] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.072120] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.072120] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.072120] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-269cb2cc-fdf0-4134-84c2-af60c805a15d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.085374] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a45a455-673b-417d-b2f6-be9352c2077e in Status: SUCCESS [ 1087.085594] env[69232]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5a45a455-673b-417d-b2f6-be9352c2077e deletion is rescheduled due to dependency. [ 1087.085708] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a45a455-673b-417d-b2f6-be9352c2077e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.275548] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bdcc7a21-dd0d-4296-ac34-a880ea6123e7 in Status: SUCCESS [ 1087.275548] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.275548] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.275548] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.275883] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.275883] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.275883] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.276042] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.276922] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.277067] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.277372] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bdcc7a21-dd0d-4296-ac34-a880ea6123e7',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.779740] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.780111] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.780111] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.780227] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.780953] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.780953] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.781173] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.781173] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.781268] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.781344] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.781602] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.781602] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.781712] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.781780] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.782117] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.782337] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.782337] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.782478] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.782569] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.782657] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.782768] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bdcc7a21-dd0d-4296-ac34-a880ea6123e7',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.287230] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bdcc7a21-dd0d-4296-ac34-a880ea6123e7: rpc.has_security_group_logging(os_id): False [ 1088.307629] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.308997] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.308997] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.308997] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.308997] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.308997] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.308997] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.308997] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.308997] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.308997] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.308997] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.309481] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.309481] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.309481] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.309481] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.309596] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.309596] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.309669] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.310215] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.310215] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.310215] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bdcc7a21-dd0d-4296-ac34-a880ea6123e7 is going to be updated. [ 1088.517397] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.517397] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.517397] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.517607] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.517779] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.536772] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bdcc7a21-dd0d-4296-ac34-a880ea6123e7 in Status: IN_PROGRESS for 2s [ 1088.572961] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: be581393-4638-4971-8e7f-56047ad132ae in Status: SUCCESS [ 1088.573163] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-be581393-4638-4971-8e7f-56047ad132ae" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.573354] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-be581393-4638-4971-8e7f-56047ad132ae" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.573580] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-be581393-4638-4971-8e7f-56047ad132ae" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.573768] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.573905] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.573992] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.574130] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.574215] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.574324] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-be581393-4638-4971-8e7f-56047ad132ae" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.574460] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('be581393-4638-4971-8e7f-56047ad132ae',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.577458] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-be581393-4638-4971-8e7f-56047ad132ae" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.577706] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-be581393-4638-4971-8e7f-56047ad132ae" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.577813] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.577933] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.581022] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.581022] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.581022] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.581022] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('be581393-4638-4971-8e7f-56047ad132ae',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.080333] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-be581393-4638-4971-8e7f-56047ad132ae taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.080760] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-be581393-4638-4971-8e7f-56047ad132ae" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.080760] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('be581393-4638-4971-8e7f-56047ad132ae',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.582622] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('be581393-4638-4971-8e7f-56047ad132ae',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.087728] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.087728] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.087728] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.087728] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.087728] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.087728] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: be581393-4638-4971-8e7f-56047ad132ae is going to be updated. [ 1090.116244] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.117154] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.117154] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.117154] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.117154] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.127174] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: be581393-4638-4971-8e7f-56047ad132ae in Status: IN_PROGRESS for 2s [ 1090.556029] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bdcc7a21-dd0d-4296-ac34-a880ea6123e7 in Status: SUCCESS [ 1090.556029] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.226795] env[69232]: INFO networking_nsxv3.common.synchronization [req-30ade41c-44b6-4a14-9551-8695f09f300c req-76cdf799-15dd-408d-8a59-6f11f1b885b6 tempest-AttachInterfacesTestJSON-1442903876 tempest-AttachInterfacesTestJSON-1442903876-project-member] Enqueued Resource ID: 0909b11c-c2d6-4d46-9a46-74243fd12a97 with Priority: HIGHEST for action security_group_members [ 1091.227358] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0909b11c-c2d6-4d46-9a46-74243fd12a97 with Priority: HIGHEST for action security_group_members [ 1091.227670] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-0909b11c-c2d6-4d46-9a46-74243fd12a97 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.227806] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0909b11c-c2d6-4d46-9a46-74243fd12a97" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.227866] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0909b11c-c2d6-4d46-9a46-74243fd12a97" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.231468] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0909b11c-c2d6-4d46-9a46-74243fd12a97" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.231652] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.231764] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.231831] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.232030] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.232215] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.232215] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0909b11c-c2d6-4d46-9a46-74243fd12a97',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.734025] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0909b11c-c2d6-4d46-9a46-74243fd12a97',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.848260] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock network-756 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.848455] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "network-756" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.848582] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "network-756" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.848866] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "network-756" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.849403] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.849589] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.849715] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.849964] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.850142] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.850746] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1091.850746] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] NeedRegenerationException {{(pid=69232) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1091.850746] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] no value, waiting for create lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1091.850746] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] value creation lock acquired {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1091.850999] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1091.850999] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Calling creation function for not-yet-present value {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1091.851110] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1091.872740] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1091.872952] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69232) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1091.873253] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Released creation lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1091.873607] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "network-756" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.874024] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock port-2d44e7e8-de4b-4be1-9d18-8cd28fa77441 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.874384] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "port-2d44e7e8-de4b-4be1-9d18-8cd28fa77441" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.874558] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "port-2d44e7e8-de4b-4be1-9d18-8cd28fa77441" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.875065] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "port-2d44e7e8-de4b-4be1-9d18-8cd28fa77441" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.875151] env[69232]: DEBUG networking_nsxv3.api.rpc [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2d44e7e8-de4b-4be1-9d18-8cd28fa77441',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.137615] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: be581393-4638-4971-8e7f-56047ad132ae in Status: SUCCESS [ 1092.138294] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-be581393-4638-4971-8e7f-56047ad132ae" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.138544] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-be581393-4638-4971-8e7f-56047ad132ae" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.138769] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-be581393-4638-4971-8e7f-56047ad132ae" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.138967] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.139101] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.139169] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.139373] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.139619] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.139728] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('be581393-4638-4971-8e7f-56047ad132ae',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.237456] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0909b11c-c2d6-4d46-9a46-74243fd12a97',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.383889] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.384175] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.384317] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.384668] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.384849] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.385037] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Segment Port 2d44e7e8-de4b-4be1-9d18-8cd28fa77441 not found, creating... [ 1092.385381] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.385561] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.385776] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.385981] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.386153] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.386527] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.386710] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.386844] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.387504] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.387649] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.387809] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Resource: SegmentPort with ID: 2d44e7e8-de4b-4be1-9d18-8cd28fa77441 is going to be created. [ 1092.413236] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.413548] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.413711] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.414058] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.414424] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.414682] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "port-2d44e7e8-de4b-4be1-9d18-8cd28fa77441" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.643423] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('be581393-4638-4971-8e7f-56047ad132ae',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.688292] env[69232]: INFO networking_nsxv3.common.synchronization [None req-97b635bf-b01d-4d54-b974-3b2b4e0c0c03 None None] Enqueued Resource ID: 2365cfcd-9662-4e12-bbd4-2c05694a4c78 with Priority: HIGHEST for action port [ 1092.688292] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2365cfcd-9662-4e12-bbd4-2c05694a4c78 with Priority: HIGHEST for action port [ 1092.688534] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-2365cfcd-9662-4e12-bbd4-2c05694a4c78 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.689169] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2365cfcd-9662-4e12-bbd4-2c05694a4c78" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.689282] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2365cfcd-9662-4e12-bbd4-2c05694a4c78" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.690782] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2365cfcd-9662-4e12-bbd4-2c05694a4c78" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.690782] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2365cfcd-9662-4e12-bbd4-2c05694a4c78',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.740563] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.740782] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.741146] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.741454] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.741569] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.741658] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0909b11c-c2d6-4d46-9a46-74243fd12a97 is going to be updated. [ 1092.783288] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.783288] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.783288] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.783288] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.783288] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.797397] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0909b11c-c2d6-4d46-9a46-74243fd12a97 in Status: IN_PROGRESS for 2s [ 1093.129351] env[69232]: INFO networking_nsxv3.common.synchronization [req-30ade41c-44b6-4a14-9551-8695f09f300c req-d6b672ad-7bfa-4dfe-b951-140bd4c8dcb7 service nova] Enqueued Resource ID: 0909b11c-c2d6-4d46-9a46-74243fd12a97 with Priority: HIGHEST for action security_group_rules [ 1093.129880] env[69232]: INFO networking_nsxv3.common.synchronization [req-30ade41c-44b6-4a14-9551-8695f09f300c req-d6b672ad-7bfa-4dfe-b951-140bd4c8dcb7 service nova] Enqueued Resource ID: 0909b11c-c2d6-4d46-9a46-74243fd12a97 with Priority: HIGHEST for action security_group_members [ 1093.131164] env[69232]: INFO networking_nsxv3.common.synchronization [req-30ade41c-44b6-4a14-9551-8695f09f300c req-d6b672ad-7bfa-4dfe-b951-140bd4c8dcb7 service nova] Enqueued Resource ID: 2d44e7e8-de4b-4be1-9d18-8cd28fa77441 with Priority: HIGHEST for action port [ 1093.133304] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0909b11c-c2d6-4d46-9a46-74243fd12a97 with Priority: HIGHEST for action security_group_rules [ 1093.133737] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0909b11c-c2d6-4d46-9a46-74243fd12a97 with Priority: HIGHEST for action security_group_members [ 1093.133981] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d44e7e8-de4b-4be1-9d18-8cd28fa77441 with Priority: HIGHEST for action port [ 1093.134397] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0909b11c-c2d6-4d46-9a46-74243fd12a97 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.136295] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0909b11c-c2d6-4d46-9a46-74243fd12a97" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.137021] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0909b11c-c2d6-4d46-9a46-74243fd12a97" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.137021] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0909b11c-c2d6-4d46-9a46-74243fd12a97" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.137021] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0909b11c-c2d6-4d46-9a46-74243fd12a97',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.138366] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-0909b11c-c2d6-4d46-9a46-74243fd12a97 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.140639] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0909b11c-c2d6-4d46-9a46-74243fd12a97" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.140639] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-2d44e7e8-de4b-4be1-9d18-8cd28fa77441 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.140639] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2d44e7e8-de4b-4be1-9d18-8cd28fa77441" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.140639] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2d44e7e8-de4b-4be1-9d18-8cd28fa77441" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.140639] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2d44e7e8-de4b-4be1-9d18-8cd28fa77441" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.140639] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2d44e7e8-de4b-4be1-9d18-8cd28fa77441',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.145996] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('be581393-4638-4971-8e7f-56047ad132ae',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.195133] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2365cfcd-9662-4e12-bbd4-2c05694a4c78 [ 1093.195133] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.195133] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.195133] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.195133] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.195133] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.195133] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2365cfcd-9662-4e12-bbd4-2c05694a4c78 already deleted. [ 1093.195133] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2365cfcd-9662-4e12-bbd4-2c05694a4c78" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.547582] env[69232]: INFO networking_nsxv3.common.synchronization [req-b9b88b15-fbf5-4c54-920d-b6b4bee7cd5b req-0206362b-a86f-4916-a630-efa3f19edcbb tempest-InstanceActionsV221TestJSON-2084763021 tempest-InstanceActionsV221TestJSON-2084763021-project-member] Enqueued Resource ID: 7f6a976f-5d10-4e43-b677-d3a20b1ba925 with Priority: HIGHEST for action security_group_members [ 1093.548746] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f6a976f-5d10-4e43-b677-d3a20b1ba925 with Priority: HIGHEST for action security_group_members [ 1093.549118] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f6a976f-5d10-4e43-b677-d3a20b1ba925 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.550378] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f6a976f-5d10-4e43-b677-d3a20b1ba925" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.550378] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f6a976f-5d10-4e43-b677-d3a20b1ba925" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.550378] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f6a976f-5d10-4e43-b677-d3a20b1ba925" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.550378] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.550378] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.550378] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.550378] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.550378] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.550378] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7f6a976f-5d10-4e43-b677-d3a20b1ba925',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.641454] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-0909b11c-c2d6-4d46-9a46-74243fd12a97 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.641454] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0909b11c-c2d6-4d46-9a46-74243fd12a97" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.645050] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2d44e7e8-de4b-4be1-9d18-8cd28fa77441 with status ACTIVE [ 1093.645050] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.645228] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.645228] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.645936] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.645936] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.645936] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.645936] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.645936] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.646259] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.646259] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.646339] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.646391] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.646545] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.647229] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.647229] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.647229] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2d44e7e8-de4b-4be1-9d18-8cd28fa77441 is going to be updated. [ 1093.651762] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.651911] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.652276] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.652489] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.652581] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.652680] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: be581393-4638-4971-8e7f-56047ad132ae is going to be updated. [ 1093.673159] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.673411] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.673524] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.673858] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.674111] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.675173] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2d44e7e8-de4b-4be1-9d18-8cd28fa77441" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.686783] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.686783] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.686783] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.686783] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.687044] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.698033] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: be581393-4638-4971-8e7f-56047ad132ae in Status: IN_PROGRESS for 2s [ 1093.978021] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock network-895 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.978021] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "network-895" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.978021] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "network-895" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.978021] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "network-895" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.978021] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.978021] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.978503] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.978875] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.979319] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.981027] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1093.981027] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] NeedRegenerationException {{(pid=69232) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1093.981027] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] no value, waiting for create lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1093.981027] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] value creation lock acquired {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1093.981027] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1093.981027] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Calling creation function for not-yet-present value {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1093.981027] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1094.001854] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1094.002356] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69232) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1094.002356] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Released creation lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1094.002531] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "network-895" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.003051] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock port-470048b6-80c5-42e6-a001-d2ad2f2bd434 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.003165] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "port-470048b6-80c5-42e6-a001-d2ad2f2bd434" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.004097] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "port-470048b6-80c5-42e6-a001-d2ad2f2bd434" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.004097] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "port-470048b6-80c5-42e6-a001-d2ad2f2bd434" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.004097] env[69232]: DEBUG networking_nsxv3.api.rpc [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('470048b6-80c5-42e6-a001-d2ad2f2bd434',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.053597] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.053597] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.053597] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.053597] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.053597] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.053597] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.053597] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.053597] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.054015] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.054015] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.054015] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7f6a976f-5d10-4e43-b677-d3a20b1ba925 already deleted. [ 1094.054162] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f6a976f-5d10-4e43-b677-d3a20b1ba925" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.512486] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.512486] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.512486] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.512867] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.512867] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.513142] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Segment Port 470048b6-80c5-42e6-a001-d2ad2f2bd434 not found, creating... [ 1094.514070] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.514350] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.514966] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.514966] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.515190] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.515587] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.515958] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.516825] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.517294] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.518388] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.518388] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Resource: SegmentPort with ID: 470048b6-80c5-42e6-a001-d2ad2f2bd434 is going to be created. [ 1094.543394] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.543713] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.543920] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.544378] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.545392] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.545979] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "port-470048b6-80c5-42e6-a001-d2ad2f2bd434" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.807611] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0909b11c-c2d6-4d46-9a46-74243fd12a97 in Status: SUCCESS [ 1094.808228] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0909b11c-c2d6-4d46-9a46-74243fd12a97" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.808228] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0909b11c-c2d6-4d46-9a46-74243fd12a97" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.808328] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0909b11c-c2d6-4d46-9a46-74243fd12a97" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.808501] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.808641] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.808696] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.808856] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.808939] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.809192] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0909b11c-c2d6-4d46-9a46-74243fd12a97',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.280501] env[69232]: INFO networking_nsxv3.common.synchronization [req-b9b88b15-fbf5-4c54-920d-b6b4bee7cd5b req-89969eff-2574-4b6b-a42f-e3a3a2584fc7 service nova] Enqueued Resource ID: 7f6a976f-5d10-4e43-b677-d3a20b1ba925 with Priority: HIGHEST for action security_group_rules [ 1095.283305] env[69232]: INFO networking_nsxv3.common.synchronization [req-b9b88b15-fbf5-4c54-920d-b6b4bee7cd5b req-89969eff-2574-4b6b-a42f-e3a3a2584fc7 service nova] Enqueued Resource ID: 7f6a976f-5d10-4e43-b677-d3a20b1ba925 with Priority: HIGHEST for action security_group_members [ 1095.283305] env[69232]: INFO networking_nsxv3.common.synchronization [req-b9b88b15-fbf5-4c54-920d-b6b4bee7cd5b req-89969eff-2574-4b6b-a42f-e3a3a2584fc7 service nova] Enqueued Resource ID: 470048b6-80c5-42e6-a001-d2ad2f2bd434 with Priority: HIGHEST for action port [ 1095.283305] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f6a976f-5d10-4e43-b677-d3a20b1ba925 with Priority: HIGHEST for action security_group_rules [ 1095.283305] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f6a976f-5d10-4e43-b677-d3a20b1ba925 with Priority: HIGHEST for action security_group_members [ 1095.283305] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 470048b6-80c5-42e6-a001-d2ad2f2bd434 with Priority: HIGHEST for action port [ 1095.283305] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7f6a976f-5d10-4e43-b677-d3a20b1ba925 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.286222] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7f6a976f-5d10-4e43-b677-d3a20b1ba925" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.286971] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7f6a976f-5d10-4e43-b677-d3a20b1ba925" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.287354] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7f6a976f-5d10-4e43-b677-d3a20b1ba925" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.287529] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7f6a976f-5d10-4e43-b677-d3a20b1ba925',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.288727] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f6a976f-5d10-4e43-b677-d3a20b1ba925 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.289386] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f6a976f-5d10-4e43-b677-d3a20b1ba925" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.289386] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f6a976f-5d10-4e43-b677-d3a20b1ba925" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.289386] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f6a976f-5d10-4e43-b677-d3a20b1ba925" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.289962] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.290200] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.290304] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.290540] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.290679] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.290863] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7f6a976f-5d10-4e43-b677-d3a20b1ba925',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.291847] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-470048b6-80c5-42e6-a001-d2ad2f2bd434 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.293177] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-470048b6-80c5-42e6-a001-d2ad2f2bd434" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.293320] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-470048b6-80c5-42e6-a001-d2ad2f2bd434" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.293616] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-470048b6-80c5-42e6-a001-d2ad2f2bd434" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.293824] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('470048b6-80c5-42e6-a001-d2ad2f2bd434',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.311777] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0909b11c-c2d6-4d46-9a46-74243fd12a97',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.352429] env[69232]: INFO networking_nsxv3.common.synchronization [None req-ca247c50-7ee4-405b-a699-a3244422c681 None None] Enqueued Resource ID: 04c0d499-cb6b-4fb8-9a36-ca7a906dee5a with Priority: HIGHEST for action port [ 1095.352429] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04c0d499-cb6b-4fb8-9a36-ca7a906dee5a with Priority: HIGHEST for action port [ 1095.356023] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-04c0d499-cb6b-4fb8-9a36-ca7a906dee5a taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.356023] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-04c0d499-cb6b-4fb8-9a36-ca7a906dee5a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.356023] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-04c0d499-cb6b-4fb8-9a36-ca7a906dee5a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.356023] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-04c0d499-cb6b-4fb8-9a36-ca7a906dee5a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.356023] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('04c0d499-cb6b-4fb8-9a36-ca7a906dee5a',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.712339] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: be581393-4638-4971-8e7f-56047ad132ae in Status: SUCCESS [ 1095.712339] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-be581393-4638-4971-8e7f-56047ad132ae" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.712339] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-be581393-4638-4971-8e7f-56047ad132ae" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.712585] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-be581393-4638-4971-8e7f-56047ad132ae" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.713245] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.713245] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.713245] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.713245] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.713245] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.713519] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-be581393-4638-4971-8e7f-56047ad132ae" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.713549] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-be581393-4638-4971-8e7f-56047ad132ae taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.713712] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-be581393-4638-4971-8e7f-56047ad132ae" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.713814] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-be581393-4638-4971-8e7f-56047ad132ae" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.714332] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-be581393-4638-4971-8e7f-56047ad132ae" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.714651] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.714799] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.714928] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.715156] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.717261] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.717405] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-be581393-4638-4971-8e7f-56047ad132ae" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.717526] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('be581393-4638-4971-8e7f-56047ad132ae',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.797736] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7f6a976f-5d10-4e43-b677-d3a20b1ba925',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.801036] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f6a976f-5d10-4e43-b677-d3a20b1ba925 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.801036] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f6a976f-5d10-4e43-b677-d3a20b1ba925" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.801036] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 470048b6-80c5-42e6-a001-d2ad2f2bd434 with status ACTIVE [ 1095.801036] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.801036] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.801036] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.801036] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.801036] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.801036] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.801036] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.801036] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.801036] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.801036] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.802765] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.803312] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.803437] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.806132] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.806237] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.806342] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 470048b6-80c5-42e6-a001-d2ad2f2bd434 is going to be updated. [ 1095.814373] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0909b11c-c2d6-4d46-9a46-74243fd12a97',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.830341] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.830341] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.830341] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.830569] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.830569] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.830886] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-470048b6-80c5-42e6-a001-d2ad2f2bd434" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.856484] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 04c0d499-cb6b-4fb8-9a36-ca7a906dee5a [ 1095.856743] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.856890] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.856974] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.857224] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.857327] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.857423] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:04c0d499-cb6b-4fb8-9a36-ca7a906dee5a already deleted. [ 1095.857551] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-04c0d499-cb6b-4fb8-9a36-ca7a906dee5a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.222167] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for be581393-4638-4971-8e7f-56047ad132ae: rpc.has_security_group_logging(os_id): False [ 1096.241690] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.241903] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.241982] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.242234] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.242341] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.242560] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.242686] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.242744] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.242932] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.243029] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.243523] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.243523] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.243523] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.243714] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.243774] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.243965] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.244313] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.244412] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.244684] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.244747] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.244913] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: be581393-4638-4971-8e7f-56047ad132ae is going to be updated. [ 1096.300580] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7f6a976f-5d10-4e43-b677-d3a20b1ba925',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.313613] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.313613] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.313613] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.313613] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.313891] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.316777] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.316935] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.316970] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.317180] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.317268] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.317366] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0909b11c-c2d6-4d46-9a46-74243fd12a97 is going to be updated. [ 1096.335978] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: be581393-4638-4971-8e7f-56047ad132ae in Status: IN_PROGRESS for 2s [ 1096.351668] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.351867] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.351937] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.352157] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.352978] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.371602] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0909b11c-c2d6-4d46-9a46-74243fd12a97 in Status: IN_PROGRESS for 2s [ 1096.803135] env[69232]: INFO networking_nsxv3.common.synchronization [req-5ee43ed4-f0db-4f38-8d5c-f4769a9bf87e req-d2d6f652-6e23-48a5-ab21-c14080efa839 tempest-ServerRescueTestJSONUnderV235-1807184072 tempest-ServerRescueTestJSONUnderV235-1807184072-project-member] Enqueued Resource ID: 16f72037-6840-4564-b3d3-94bf5ff60708 with Priority: HIGHEST for action security_group_members [ 1096.803598] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.804926] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.804926] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.804926] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.804926] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.804926] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7f6a976f-5d10-4e43-b677-d3a20b1ba925 is going to be created. [ 1096.806365] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16f72037-6840-4564-b3d3-94bf5ff60708 with Priority: HIGHEST for action security_group_members [ 1096.806823] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-16f72037-6840-4564-b3d3-94bf5ff60708 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.806941] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16f72037-6840-4564-b3d3-94bf5ff60708" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.807045] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16f72037-6840-4564-b3d3-94bf5ff60708" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.807322] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16f72037-6840-4564-b3d3-94bf5ff60708" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.809024] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.809024] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.809024] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.809024] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.809024] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.809024] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('16f72037-6840-4564-b3d3-94bf5ff60708',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.837822] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.837822] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.837822] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.837822] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.838462] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.852118] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7f6a976f-5d10-4e43-b677-d3a20b1ba925 in Status: UNINITIALIZED for 2s [ 1097.136520] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock network-964 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.136737] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "network-964" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.136853] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "network-964" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.137225] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "network-964" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.137520] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.137688] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.138073] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.139499] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.139499] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.139499] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1097.139499] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] NeedRegenerationException {{(pid=69232) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1097.139499] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] no value, waiting for create lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1097.139499] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] value creation lock acquired {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1097.139499] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1097.139499] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Calling creation function for not-yet-present value {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1097.139499] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1097.170467] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1097.170705] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Cache value generated in 0.031 seconds for key(s): 'zone-id' {{(pid=69232) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1097.171508] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Released creation lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1097.171508] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "network-964" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.171508] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock port-6bb4e96d-1c12-4deb-81b2-4120928b5401 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.171943] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "port-6bb4e96d-1c12-4deb-81b2-4120928b5401" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.171943] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "port-6bb4e96d-1c12-4deb-81b2-4120928b5401" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.172067] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "port-6bb4e96d-1c12-4deb-81b2-4120928b5401" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.172281] env[69232]: DEBUG networking_nsxv3.api.rpc [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6bb4e96d-1c12-4deb-81b2-4120928b5401',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.312524] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.312723] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.312723] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.313034] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.313034] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.316142] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.316142] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.316142] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.316142] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.316142] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.316142] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 16f72037-6840-4564-b3d3-94bf5ff60708 already deleted. [ 1097.316142] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16f72037-6840-4564-b3d3-94bf5ff60708" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.674995] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.675332] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.675485] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.676181] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.676181] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.676181] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Segment Port 6bb4e96d-1c12-4deb-81b2-4120928b5401 not found, creating... [ 1097.676559] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.677015] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.677106] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.677410] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.677645] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.678138] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.678343] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.678583] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.678911] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.679164] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.679389] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Resource: SegmentPort with ID: 6bb4e96d-1c12-4deb-81b2-4120928b5401 is going to be created. [ 1097.710034] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.710420] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.710547] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.710977] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.711357] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.711649] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "port-6bb4e96d-1c12-4deb-81b2-4120928b5401" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.193102] env[69232]: INFO networking_nsxv3.common.synchronization [req-04188c3e-1c68-4293-a3c1-7969b359e1f5 req-10bdc2b2-6beb-4a43-b678-997419373192 tempest-ServersTestJSON-524901877 tempest-ServersTestJSON-524901877-project-member] Enqueued Resource ID: bdcc7a21-dd0d-4296-ac34-a880ea6123e7 with Priority: HIGHEST for action security_group_members [ 1098.193752] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdcc7a21-dd0d-4296-ac34-a880ea6123e7 with Priority: HIGHEST for action security_group_members [ 1098.194210] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.194354] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.194458] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.194736] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.194927] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.195056] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.195121] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.195295] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.195387] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.195486] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bdcc7a21-dd0d-4296-ac34-a880ea6123e7',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.349608] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: be581393-4638-4971-8e7f-56047ad132ae in Status: SUCCESS [ 1098.350114] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-be581393-4638-4971-8e7f-56047ad132ae" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.350298] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-be581393-4638-4971-8e7f-56047ad132ae" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.350522] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-be581393-4638-4971-8e7f-56047ad132ae" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.350613] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('be581393-4638-4971-8e7f-56047ad132ae',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.382089] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0909b11c-c2d6-4d46-9a46-74243fd12a97 in Status: SUCCESS [ 1098.382329] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0909b11c-c2d6-4d46-9a46-74243fd12a97" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.382496] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0909b11c-c2d6-4d46-9a46-74243fd12a97" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.382764] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0909b11c-c2d6-4d46-9a46-74243fd12a97" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.383051] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.383191] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.383255] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.383446] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.383513] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.383682] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0909b11c-c2d6-4d46-9a46-74243fd12a97" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.383682] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0909b11c-c2d6-4d46-9a46-74243fd12a97',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.698283] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bdcc7a21-dd0d-4296-ac34-a880ea6123e7',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.838016] env[69232]: INFO networking_nsxv3.common.synchronization [req-5ee43ed4-f0db-4f38-8d5c-f4769a9bf87e req-a807c031-c25b-4936-8ba5-216da68c4cab service nova] Enqueued Resource ID: 16f72037-6840-4564-b3d3-94bf5ff60708 with Priority: HIGHEST for action security_group_rules [ 1098.838016] env[69232]: INFO networking_nsxv3.common.synchronization [req-5ee43ed4-f0db-4f38-8d5c-f4769a9bf87e req-a807c031-c25b-4936-8ba5-216da68c4cab service nova] Enqueued Resource ID: 16f72037-6840-4564-b3d3-94bf5ff60708 with Priority: HIGHEST for action security_group_members [ 1098.838016] env[69232]: INFO networking_nsxv3.common.synchronization [req-5ee43ed4-f0db-4f38-8d5c-f4769a9bf87e req-a807c031-c25b-4936-8ba5-216da68c4cab service nova] Enqueued Resource ID: 6bb4e96d-1c12-4deb-81b2-4120928b5401 with Priority: HIGHEST for action port [ 1098.838016] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16f72037-6840-4564-b3d3-94bf5ff60708 with Priority: HIGHEST for action security_group_rules [ 1098.838016] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16f72037-6840-4564-b3d3-94bf5ff60708 with Priority: HIGHEST for action security_group_members [ 1098.838016] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6bb4e96d-1c12-4deb-81b2-4120928b5401 with Priority: HIGHEST for action port [ 1098.838016] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-16f72037-6840-4564-b3d3-94bf5ff60708 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.838530] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-16f72037-6840-4564-b3d3-94bf5ff60708" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.838530] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-16f72037-6840-4564-b3d3-94bf5ff60708" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.838646] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-16f72037-6840-4564-b3d3-94bf5ff60708" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.838769] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('16f72037-6840-4564-b3d3-94bf5ff60708',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.840592] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-16f72037-6840-4564-b3d3-94bf5ff60708 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.840592] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16f72037-6840-4564-b3d3-94bf5ff60708" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.840592] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16f72037-6840-4564-b3d3-94bf5ff60708" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.840592] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16f72037-6840-4564-b3d3-94bf5ff60708" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.840844] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.840844] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.840844] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.840971] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.841258] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.841258] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('16f72037-6840-4564-b3d3-94bf5ff60708',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.842060] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-6bb4e96d-1c12-4deb-81b2-4120928b5401 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.842152] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6bb4e96d-1c12-4deb-81b2-4120928b5401" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.842152] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6bb4e96d-1c12-4deb-81b2-4120928b5401" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.842286] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6bb4e96d-1c12-4deb-81b2-4120928b5401" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.844873] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6bb4e96d-1c12-4deb-81b2-4120928b5401',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.853244] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-be581393-4638-4971-8e7f-56047ad132ae taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.853244] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-be581393-4638-4971-8e7f-56047ad132ae" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.853244] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-be581393-4638-4971-8e7f-56047ad132ae" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.853479] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-be581393-4638-4971-8e7f-56047ad132ae" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.853673] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.853764] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.853827] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.854026] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.854186] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.854247] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-be581393-4638-4971-8e7f-56047ad132ae" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.854302] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('be581393-4638-4971-8e7f-56047ad132ae',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.867758] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7f6a976f-5d10-4e43-b677-d3a20b1ba925 in Status: SUCCESS [ 1098.867972] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f6a976f-5d10-4e43-b677-d3a20b1ba925" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.868838] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f6a976f-5d10-4e43-b677-d3a20b1ba925" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.869075] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f6a976f-5d10-4e43-b677-d3a20b1ba925" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.869267] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.869403] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.869472] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.869635] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.869716] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.869805] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f6a976f-5d10-4e43-b677-d3a20b1ba925" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.872108] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7f6a976f-5d10-4e43-b677-d3a20b1ba925',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.886334] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0909b11c-c2d6-4d46-9a46-74243fd12a97',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.891399] env[69232]: INFO networking_nsxv3.common.synchronization [req-c03c05cf-798b-4ca3-b3d0-2013b454be16 req-263db2fb-3aae-4d04-a49c-7c347a443dc0 tempest-MultipleCreateTestJSON-2129230941 tempest-MultipleCreateTestJSON-2129230941-project-member] Enqueued Resource ID: be581393-4638-4971-8e7f-56047ad132ae with Priority: HIGHEST for action security_group_members [ 1098.891913] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: be581393-4638-4971-8e7f-56047ad132ae with Priority: HIGHEST for action security_group_members [ 1098.892222] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-be581393-4638-4971-8e7f-56047ad132ae taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.892664] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-be581393-4638-4971-8e7f-56047ad132ae" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.892664] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-be581393-4638-4971-8e7f-56047ad132ae" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.892664] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-be581393-4638-4971-8e7f-56047ad132ae" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.892805] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.892861] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.892893] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.893743] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.893908] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.894296] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('be581393-4638-4971-8e7f-56047ad132ae',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.095134] env[69232]: INFO networking_nsxv3.common.synchronization [req-47300b9d-c8a2-44a9-84c9-551294966d1c req-5c25bd9c-2d71-4b52-82e0-7b3a9b97f035 tempest-MultipleCreateTestJSON-2129230941 tempest-MultipleCreateTestJSON-2129230941-project-member] Enqueued Resource ID: be581393-4638-4971-8e7f-56047ad132ae with Priority: HIGHEST for action security_group_members [ 1099.096718] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: be581393-4638-4971-8e7f-56047ad132ae with Priority: HIGHEST for action security_group_members [ 1099.097117] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-be581393-4638-4971-8e7f-56047ad132ae taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.097229] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-be581393-4638-4971-8e7f-56047ad132ae" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.200719] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bdcc7a21-dd0d-4296-ac34-a880ea6123e7',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.344320] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('16f72037-6840-4564-b3d3-94bf5ff60708',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.345437] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-16f72037-6840-4564-b3d3-94bf5ff60708 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.345570] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16f72037-6840-4564-b3d3-94bf5ff60708" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.346615] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6bb4e96d-1c12-4deb-81b2-4120928b5401 with status ACTIVE [ 1099.347085] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.347237] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.347314] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.347643] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.347643] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.347858] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.348062] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.348062] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.348269] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.348345] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.348556] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.348658] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.348743] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.349102] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.349102] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.349102] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6bb4e96d-1c12-4deb-81b2-4120928b5401 is going to be updated. [ 1099.358062] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-be581393-4638-4971-8e7f-56047ad132ae taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.358268] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-be581393-4638-4971-8e7f-56047ad132ae" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.374311] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.374590] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.374590] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.374801] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.374949] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.375158] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6bb4e96d-1c12-4deb-81b2-4120928b5401" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.375866] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f6a976f-5d10-4e43-b677-d3a20b1ba925 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.375992] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f6a976f-5d10-4e43-b677-d3a20b1ba925" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.376089] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f6a976f-5d10-4e43-b677-d3a20b1ba925" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.376312] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f6a976f-5d10-4e43-b677-d3a20b1ba925" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.376487] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.376631] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.376713] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.376917] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.376917] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.377090] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f6a976f-5d10-4e43-b677-d3a20b1ba925" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.377167] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f6a976f-5d10-4e43-b677-d3a20b1ba925 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.377357] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f6a976f-5d10-4e43-b677-d3a20b1ba925" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.377357] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f6a976f-5d10-4e43-b677-d3a20b1ba925" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.377497] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f6a976f-5d10-4e43-b677-d3a20b1ba925" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.377611] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.377717] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.377801] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.377924] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.377999] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.378155] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f6a976f-5d10-4e43-b677-d3a20b1ba925" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.378206] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7f6a976f-5d10-4e43-b677-d3a20b1ba925',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.390702] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0909b11c-c2d6-4d46-9a46-74243fd12a97: rpc.has_security_group_logging(os_id): False [ 1099.395788] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('be581393-4638-4971-8e7f-56047ad132ae',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.413030] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.413030] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.413030] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.413030] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.413030] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.413030] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.413030] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.413030] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.413030] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.413030] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.413030] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0909b11c-c2d6-4d46-9a46-74243fd12a97 is going to be updated. [ 1099.538479] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.538679] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.538743] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.538925] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.539090] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.566590] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0909b11c-c2d6-4d46-9a46-74243fd12a97 in Status: IN_PROGRESS for 2s [ 1099.704096] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.704096] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.704096] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.704096] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.704096] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.704096] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bdcc7a21-dd0d-4296-ac34-a880ea6123e7 is going to be updated. [ 1099.736431] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.736611] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.736660] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.736862] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.737012] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.751485] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bdcc7a21-dd0d-4296-ac34-a880ea6123e7 in Status: IN_PROGRESS for 2s [ 1099.847643] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('16f72037-6840-4564-b3d3-94bf5ff60708',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.880352] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7f6a976f-5d10-4e43-b677-d3a20b1ba925: rpc.has_security_group_logging(os_id): False [ 1099.898664] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.898867] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.898966] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.899268] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.899389] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.899679] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.899813] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.899901] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.900129] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.900235] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.900480] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.900608] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.900693] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.900879] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.900984] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.901247] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.901374] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.901547] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.901742] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.901844] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.901963] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7f6a976f-5d10-4e43-b677-d3a20b1ba925 is going to be created. [ 1099.903560] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('be581393-4638-4971-8e7f-56047ad132ae',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.970152] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.970441] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.970441] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.970686] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.970821] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.984240] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7f6a976f-5d10-4e43-b677-d3a20b1ba925 in Status: IN_PROGRESS for 2s [ 1100.352607] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.352607] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.352607] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.352607] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.352607] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.352607] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 16f72037-6840-4564-b3d3-94bf5ff60708 is going to be created. [ 1100.381478] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.381643] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.381723] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.382038] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.382250] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.393712] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16f72037-6840-4564-b3d3-94bf5ff60708 in Status: UNINITIALIZED for 2s [ 1100.407366] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.407641] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.407698] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.408069] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.408222] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.408377] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: be581393-4638-4971-8e7f-56047ad132ae is going to be updated. [ 1100.440910] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.441194] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.441277] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.441678] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.441835] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.451015] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: be581393-4638-4971-8e7f-56047ad132ae in Status: IN_PROGRESS for 2s [ 1101.583723] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0909b11c-c2d6-4d46-9a46-74243fd12a97 in Status: SUCCESS [ 1101.584181] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0909b11c-c2d6-4d46-9a46-74243fd12a97" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.763334] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bdcc7a21-dd0d-4296-ac34-a880ea6123e7 in Status: SUCCESS [ 1101.764046] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.996346] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7f6a976f-5d10-4e43-b677-d3a20b1ba925 in Status: SUCCESS [ 1101.996718] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7f6a976f-5d10-4e43-b677-d3a20b1ba925" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.405826] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16f72037-6840-4564-b3d3-94bf5ff60708 in Status: SUCCESS [ 1102.406579] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16f72037-6840-4564-b3d3-94bf5ff60708" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.406958] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16f72037-6840-4564-b3d3-94bf5ff60708" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.407312] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16f72037-6840-4564-b3d3-94bf5ff60708" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.407613] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.407869] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.408054] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.408332] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.408511] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.408704] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16f72037-6840-4564-b3d3-94bf5ff60708" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.408887] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('16f72037-6840-4564-b3d3-94bf5ff60708',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.461428] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: be581393-4638-4971-8e7f-56047ad132ae in Status: SUCCESS [ 1102.463440] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-be581393-4638-4971-8e7f-56047ad132ae" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.463440] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-be581393-4638-4971-8e7f-56047ad132ae" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.463440] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-be581393-4638-4971-8e7f-56047ad132ae" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.463440] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.463440] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.463440] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.463440] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.463440] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.463440] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('be581393-4638-4971-8e7f-56047ad132ae',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.912185] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-16f72037-6840-4564-b3d3-94bf5ff60708 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.912782] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16f72037-6840-4564-b3d3-94bf5ff60708" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.912782] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16f72037-6840-4564-b3d3-94bf5ff60708" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.912782] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16f72037-6840-4564-b3d3-94bf5ff60708" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.912782] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.913101] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.913101] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.913334] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.913334] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.913476] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16f72037-6840-4564-b3d3-94bf5ff60708" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.913678] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-16f72037-6840-4564-b3d3-94bf5ff60708 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.913801] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16f72037-6840-4564-b3d3-94bf5ff60708" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.913801] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16f72037-6840-4564-b3d3-94bf5ff60708" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.914031] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16f72037-6840-4564-b3d3-94bf5ff60708" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.915052] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.915052] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.915052] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.915052] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.915052] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.915052] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16f72037-6840-4564-b3d3-94bf5ff60708" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.915052] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('16f72037-6840-4564-b3d3-94bf5ff60708',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.966737] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.966954] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.966954] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.967193] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.967284] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.967496] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.967595] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.967657] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.967818] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.967904] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.967995] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: be581393-4638-4971-8e7f-56047ad132ae is going to be updated. [ 1103.002703] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.002842] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.003027] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.003144] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.003350] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.020634] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: be581393-4638-4971-8e7f-56047ad132ae in Status: IN_PROGRESS for 2s [ 1103.418237] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 16f72037-6840-4564-b3d3-94bf5ff60708: rpc.has_security_group_logging(os_id): False [ 1103.439390] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.439390] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.439390] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.439390] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.439390] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.439390] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.439390] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.439390] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.439390] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.439390] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.439956] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.439956] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.439956] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.439956] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.439956] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.440201] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.440201] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.440201] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.440359] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.440409] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.441049] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 16f72037-6840-4564-b3d3-94bf5ff60708 is going to be created. [ 1103.509126] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.509346] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.509392] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.509583] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.509915] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.525768] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 16f72037-6840-4564-b3d3-94bf5ff60708 in Status: IN_PROGRESS for 2s [ 1104.097500] env[69232]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1104.098136] env[69232]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=3 [ 1104.610843] env[69232]: INFO networking_nsxv3.common.synchronization [None req-18fa5904-def6-427e-a171-a522d4075521 tempest-AttachInterfacesTestJSON-1442903876 tempest-AttachInterfacesTestJSON-1442903876-project-member] Enqueued Resource ID: 20ba03af-aba0-4fe6-af1e-ea103067fcbe with Priority: HIGHEST for action security_group_members [ 1104.611542] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20ba03af-aba0-4fe6-af1e-ea103067fcbe with Priority: HIGHEST for action security_group_members [ 1104.612069] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-20ba03af-aba0-4fe6-af1e-ea103067fcbe taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.612069] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-20ba03af-aba0-4fe6-af1e-ea103067fcbe" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.612069] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-20ba03af-aba0-4fe6-af1e-ea103067fcbe" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.612336] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-20ba03af-aba0-4fe6-af1e-ea103067fcbe" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.613048] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.613048] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.613231] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.614238] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.614238] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.614238] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('20ba03af-aba0-4fe6-af1e-ea103067fcbe',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.030106] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: be581393-4638-4971-8e7f-56047ad132ae in Status: SUCCESS [ 1105.030329] env[69232]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: be581393-4638-4971-8e7f-56047ad132ae deletion is rescheduled due to dependency. [ 1105.030393] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-be581393-4638-4971-8e7f-56047ad132ae" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.030516] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-be581393-4638-4971-8e7f-56047ad132ae" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.030735] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-be581393-4638-4971-8e7f-56047ad132ae" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.030926] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.031058] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.031124] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.031284] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.031365] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.031452] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-be581393-4638-4971-8e7f-56047ad132ae" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.031962] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-be581393-4638-4971-8e7f-56047ad132ae taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.031962] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-be581393-4638-4971-8e7f-56047ad132ae" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.031962] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-be581393-4638-4971-8e7f-56047ad132ae" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.032271] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-be581393-4638-4971-8e7f-56047ad132ae" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.032271] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.032625] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.032625] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.032625] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.032625] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.032625] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-be581393-4638-4971-8e7f-56047ad132ae" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.032808] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('be581393-4638-4971-8e7f-56047ad132ae',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.119745] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.120084] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.120084] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.120263] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.141740] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.141860] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.142011] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.142106] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.142309] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.142387] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.142478] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 20ba03af-aba0-4fe6-af1e-ea103067fcbe is going to be updated. [ 1105.167240] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.167418] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.167460] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.167640] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.167777] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.178128] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 20ba03af-aba0-4fe6-af1e-ea103067fcbe in Status: IN_PROGRESS for 2s [ 1105.535489] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for be581393-4638-4971-8e7f-56047ad132ae: rpc.has_security_group_logging(os_id): False [ 1105.549648] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 16f72037-6840-4564-b3d3-94bf5ff60708 in Status: SUCCESS [ 1105.550077] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-16f72037-6840-4564-b3d3-94bf5ff60708" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.558627] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.558876] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.558990] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.559365] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.559554] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.559930] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.560488] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.560648] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.560973] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.561439] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.561975] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.562938] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.563091] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.566614] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.566614] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.566614] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.566614] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.566614] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.566614] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.566614] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.566614] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: be581393-4638-4971-8e7f-56047ad132ae is going to be updated. [ 1105.652268] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.652656] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.652656] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.653041] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.653300] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.692862] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: be581393-4638-4971-8e7f-56047ad132ae in Status: IN_PROGRESS for 2s [ 1105.812949] env[69232]: INFO networking_nsxv3.common.synchronization [req-60eb7da3-7e9e-4fb7-9a1f-e498f372a74c req-ad602663-e064-4bb8-870b-db2d44212439 tempest-InstanceActionsNegativeTestJSON-1908515503 tempest-InstanceActionsNegativeTestJSON-1908515503-project-member] Enqueued Resource ID: e5f0070b-6fd5-4e89-a697-f74b50d1833f with Priority: HIGHEST for action security_group_members [ 1105.813935] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5f0070b-6fd5-4e89-a697-f74b50d1833f with Priority: HIGHEST for action security_group_members [ 1105.814049] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5f0070b-6fd5-4e89-a697-f74b50d1833f taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.814177] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5f0070b-6fd5-4e89-a697-f74b50d1833f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.814610] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5f0070b-6fd5-4e89-a697-f74b50d1833f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.814610] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5f0070b-6fd5-4e89-a697-f74b50d1833f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.816399] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.816399] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.816399] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.816399] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.816672] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.816672] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e5f0070b-6fd5-4e89-a697-f74b50d1833f',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.319870] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.320219] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.320219] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.320327] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.320864] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.320864] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.320864] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.320864] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.320864] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.321124] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.321124] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e5f0070b-6fd5-4e89-a697-f74b50d1833f already deleted. [ 1106.321124] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5f0070b-6fd5-4e89-a697-f74b50d1833f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.377722] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock network-677 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.377980] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "network-677" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.378121] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "network-677" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.378433] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "network-677" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.378695] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.378848] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.378995] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.380330] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.380579] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.380875] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1106.381511] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] NeedRegenerationException {{(pid=69232) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1106.381511] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] no value, waiting for create lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1106.381511] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] value creation lock acquired {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1106.381511] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1106.381679] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Calling creation function for not-yet-present value {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1106.381925] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1106.401491] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1106.401713] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69232) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1106.401864] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Released creation lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1106.402053] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "network-677" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.402386] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock port-5729e6a7-d28f-4dc8-af7f-e54c045fc916 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.402590] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "port-5729e6a7-d28f-4dc8-af7f-e54c045fc916" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.402721] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "port-5729e6a7-d28f-4dc8-af7f-e54c045fc916" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.403073] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "port-5729e6a7-d28f-4dc8-af7f-e54c045fc916" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.403221] env[69232]: DEBUG networking_nsxv3.api.rpc [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5729e6a7-d28f-4dc8-af7f-e54c045fc916',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.909149] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.909149] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.909149] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.909149] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.909149] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.909149] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Segment Port 5729e6a7-d28f-4dc8-af7f-e54c045fc916 not found, creating... [ 1106.909149] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.909149] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.909149] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.909149] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.909149] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.909823] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.909823] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.909823] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.909823] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.910290] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.910601] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Resource: SegmentPort with ID: 5729e6a7-d28f-4dc8-af7f-e54c045fc916 is going to be created. [ 1106.950209] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.950209] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.950353] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.950608] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.950866] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.951148] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "port-5729e6a7-d28f-4dc8-af7f-e54c045fc916" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.011019] env[69232]: INFO networking_nsxv3.common.synchronization [req-103f6818-c842-4c3a-b38c-7bcb5383deec req-25dd22a4-6f07-4796-b759-61ed50f5fb47 tempest-InstanceActionsV221TestJSON-2084763021 tempest-InstanceActionsV221TestJSON-2084763021-project-member] Enqueued Resource ID: 7f6a976f-5d10-4e43-b677-d3a20b1ba925 with Priority: HIGHEST for action security_group_members [ 1107.011468] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f6a976f-5d10-4e43-b677-d3a20b1ba925 with Priority: HIGHEST for action security_group_members [ 1107.011978] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f6a976f-5d10-4e43-b677-d3a20b1ba925 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.011978] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f6a976f-5d10-4e43-b677-d3a20b1ba925" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.011978] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f6a976f-5d10-4e43-b677-d3a20b1ba925" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.012274] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f6a976f-5d10-4e43-b677-d3a20b1ba925" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.012342] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.012416] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.013274] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.013498] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.013617] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.013727] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7f6a976f-5d10-4e43-b677-d3a20b1ba925',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.189475] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 20ba03af-aba0-4fe6-af1e-ea103067fcbe in Status: SUCCESS [ 1107.189475] env[69232]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 20ba03af-aba0-4fe6-af1e-ea103067fcbe deletion is rescheduled due to dependency. [ 1107.189475] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-20ba03af-aba0-4fe6-af1e-ea103067fcbe" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.203016] env[69232]: INFO networking_nsxv3.common.synchronization [req-8f52eef8-1e3d-4c79-baf3-cf20aa06cc57 req-ed588a28-a4c1-4c66-92f4-787de53eaf3a tempest-AttachVolumeNegativeTest-731570695 tempest-AttachVolumeNegativeTest-731570695-project-member] Enqueued Resource ID: 9dfe0542-c4f4-46ef-bdfa-784cec941ec2 with Priority: HIGHEST for action security_group_members [ 1107.204394] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9dfe0542-c4f4-46ef-bdfa-784cec941ec2 with Priority: HIGHEST for action security_group_members [ 1107.206101] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-9dfe0542-c4f4-46ef-bdfa-784cec941ec2 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.206101] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9dfe0542-c4f4-46ef-bdfa-784cec941ec2" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.206101] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9dfe0542-c4f4-46ef-bdfa-784cec941ec2" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.206101] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9dfe0542-c4f4-46ef-bdfa-784cec941ec2" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.206101] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.206101] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.206101] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.206101] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.206101] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.206101] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9dfe0542-c4f4-46ef-bdfa-784cec941ec2',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.520514] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.520514] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.520514] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.520514] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.520514] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.520514] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.520514] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.520514] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.520514] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.520514] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.520514] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7f6a976f-5d10-4e43-b677-d3a20b1ba925 is going to be updated. [ 1107.551428] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.551428] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.551428] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.551428] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.551428] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.560427] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7f6a976f-5d10-4e43-b677-d3a20b1ba925 in Status: IN_PROGRESS for 2s [ 1107.708435] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.708670] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.708751] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.709037] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.710778] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: be581393-4638-4971-8e7f-56047ad132ae in Status: SUCCESS [ 1107.710980] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-be581393-4638-4971-8e7f-56047ad132ae" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.729476] env[69232]: INFO networking_nsxv3.common.synchronization [req-60eb7da3-7e9e-4fb7-9a1f-e498f372a74c req-6c5272a6-f3db-402c-8499-18671bbb736e service nova] Enqueued Resource ID: e5f0070b-6fd5-4e89-a697-f74b50d1833f with Priority: HIGHEST for action security_group_rules [ 1107.729733] env[69232]: INFO networking_nsxv3.common.synchronization [req-60eb7da3-7e9e-4fb7-9a1f-e498f372a74c req-6c5272a6-f3db-402c-8499-18671bbb736e service nova] Enqueued Resource ID: e5f0070b-6fd5-4e89-a697-f74b50d1833f with Priority: HIGHEST for action security_group_members [ 1107.729874] env[69232]: INFO networking_nsxv3.common.synchronization [req-60eb7da3-7e9e-4fb7-9a1f-e498f372a74c req-6c5272a6-f3db-402c-8499-18671bbb736e service nova] Enqueued Resource ID: 5729e6a7-d28f-4dc8-af7f-e54c045fc916 with Priority: HIGHEST for action port [ 1107.730449] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5f0070b-6fd5-4e89-a697-f74b50d1833f with Priority: HIGHEST for action security_group_rules [ 1107.730560] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5f0070b-6fd5-4e89-a697-f74b50d1833f with Priority: HIGHEST for action security_group_members [ 1107.731150] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5729e6a7-d28f-4dc8-af7f-e54c045fc916 with Priority: HIGHEST for action port [ 1107.731765] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e5f0070b-6fd5-4e89-a697-f74b50d1833f taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.731765] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e5f0070b-6fd5-4e89-a697-f74b50d1833f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.731765] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e5f0070b-6fd5-4e89-a697-f74b50d1833f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.732011] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e5f0070b-6fd5-4e89-a697-f74b50d1833f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.732011] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e5f0070b-6fd5-4e89-a697-f74b50d1833f',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.733071] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5f0070b-6fd5-4e89-a697-f74b50d1833f taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.733419] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5f0070b-6fd5-4e89-a697-f74b50d1833f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.733500] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5f0070b-6fd5-4e89-a697-f74b50d1833f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.734406] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5f0070b-6fd5-4e89-a697-f74b50d1833f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.734869] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.734869] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.734869] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.735053] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.735053] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.735742] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e5f0070b-6fd5-4e89-a697-f74b50d1833f',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.736634] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-5729e6a7-d28f-4dc8-af7f-e54c045fc916 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.736753] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5729e6a7-d28f-4dc8-af7f-e54c045fc916" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.737301] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5729e6a7-d28f-4dc8-af7f-e54c045fc916" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.737659] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5729e6a7-d28f-4dc8-af7f-e54c045fc916" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.737777] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5729e6a7-d28f-4dc8-af7f-e54c045fc916',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.739333] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.739803] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.739981] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.740415] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.740639] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.741154] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.741154] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9dfe0542-c4f4-46ef-bdfa-784cec941ec2 is going to be updated. [ 1107.771230] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.771230] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.771230] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.771230] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.771230] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.778968] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9dfe0542-c4f4-46ef-bdfa-784cec941ec2 in Status: IN_PROGRESS for 2s [ 1108.243688] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e5f0070b-6fd5-4e89-a697-f74b50d1833f',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.245862] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5f0070b-6fd5-4e89-a697-f74b50d1833f taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.247463] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5f0070b-6fd5-4e89-a697-f74b50d1833f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.251486] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5729e6a7-d28f-4dc8-af7f-e54c045fc916 with status ACTIVE [ 1108.251769] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.251894] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.251958] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.252186] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.252273] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.252983] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.253135] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.253194] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.253346] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.253427] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.253673] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.253769] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.253831] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.253976] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.254072] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.254186] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5729e6a7-d28f-4dc8-af7f-e54c045fc916 is going to be updated. [ 1108.277431] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.278781] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.278781] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.278781] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.278781] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.278781] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5729e6a7-d28f-4dc8-af7f-e54c045fc916" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.753317] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e5f0070b-6fd5-4e89-a697-f74b50d1833f',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.255903] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.256174] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.256307] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.256627] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.256825] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.257014] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e5f0070b-6fd5-4e89-a697-f74b50d1833f is going to be created. [ 1109.283984] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.284156] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.284407] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.284746] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.284746] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.299542] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5f0070b-6fd5-4e89-a697-f74b50d1833f in Status: UNINITIALIZED for 2s [ 1109.572147] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7f6a976f-5d10-4e43-b677-d3a20b1ba925 in Status: SUCCESS [ 1109.572147] env[69232]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7f6a976f-5d10-4e43-b677-d3a20b1ba925 deletion is rescheduled due to dependency. [ 1109.572147] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f6a976f-5d10-4e43-b677-d3a20b1ba925" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.791013] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9dfe0542-c4f4-46ef-bdfa-784cec941ec2 in Status: SUCCESS [ 1109.791349] env[69232]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9dfe0542-c4f4-46ef-bdfa-784cec941ec2 deletion is rescheduled due to dependency. [ 1109.791349] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9dfe0542-c4f4-46ef-bdfa-784cec941ec2" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.074013] env[69232]: INFO networking_nsxv3.common.synchronization [None req-051018c2-6e99-46c6-85ed-fc188bda6a9d None None] Enqueued Resource ID: 315b013e-dd7b-497d-afcb-145a696a62bd with Priority: HIGHEST for action port [ 1110.074602] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 315b013e-dd7b-497d-afcb-145a696a62bd with Priority: HIGHEST for action port [ 1110.074922] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-315b013e-dd7b-497d-afcb-145a696a62bd taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.075061] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-315b013e-dd7b-497d-afcb-145a696a62bd" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.075127] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-315b013e-dd7b-497d-afcb-145a696a62bd" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.075713] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-315b013e-dd7b-497d-afcb-145a696a62bd" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.075713] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('315b013e-dd7b-497d-afcb-145a696a62bd',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.356083] env[69232]: INFO networking_nsxv3.common.synchronization [req-ccadfde3-3a5b-4dc9-8c37-2dd9741dba12 req-6fe1e21a-d20a-409e-84ef-d3a00e20fe16 tempest-ServersTestJSON-524901877 tempest-ServersTestJSON-524901877-project-member] Enqueued Resource ID: bdcc7a21-dd0d-4296-ac34-a880ea6123e7 with Priority: HIGHEST for action security_group_members [ 1110.357166] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdcc7a21-dd0d-4296-ac34-a880ea6123e7 with Priority: HIGHEST for action security_group_members [ 1110.357166] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.357166] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.357166] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.357417] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.357522] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.357620] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.357682] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.358176] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.358176] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.358176] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bdcc7a21-dd0d-4296-ac34-a880ea6123e7',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.579934] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 315b013e-dd7b-497d-afcb-145a696a62bd [ 1110.580681] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.580851] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.580918] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.581198] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.581509] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.581723] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:315b013e-dd7b-497d-afcb-145a696a62bd already deleted. [ 1110.581894] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-315b013e-dd7b-497d-afcb-145a696a62bd" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.860952] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bdcc7a21-dd0d-4296-ac34-a880ea6123e7',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.151655] env[69232]: INFO networking_nsxv3.common.synchronization [req-874b4423-3aa2-4fd0-8f51-487c532f6383 req-56b83fb2-73e4-449c-b279-3aa8775d661a tempest-ServerActionsTestJSON-973196373 tempest-ServerActionsTestJSON-973196373-project-member] Enqueued Resource ID: adac9a54-9bb6-4368-a762-389898a52bd9 with Priority: HIGHEST for action security_group_members [ 1111.151951] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: adac9a54-9bb6-4368-a762-389898a52bd9 with Priority: HIGHEST for action security_group_members [ 1111.155018] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-adac9a54-9bb6-4368-a762-389898a52bd9 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.155018] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-adac9a54-9bb6-4368-a762-389898a52bd9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.155018] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-adac9a54-9bb6-4368-a762-389898a52bd9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.155018] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-adac9a54-9bb6-4368-a762-389898a52bd9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.155018] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.155018] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.155018] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.155018] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.155018] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.155018] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('adac9a54-9bb6-4368-a762-389898a52bd9',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.311753] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5f0070b-6fd5-4e89-a697-f74b50d1833f in Status: SUCCESS [ 1111.311981] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5f0070b-6fd5-4e89-a697-f74b50d1833f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.312236] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5f0070b-6fd5-4e89-a697-f74b50d1833f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.312505] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5f0070b-6fd5-4e89-a697-f74b50d1833f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.312807] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.312963] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.313045] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.313233] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.313309] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.313398] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5f0070b-6fd5-4e89-a697-f74b50d1833f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.313490] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e5f0070b-6fd5-4e89-a697-f74b50d1833f',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.362945] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bdcc7a21-dd0d-4296-ac34-a880ea6123e7',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.656319] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.656522] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.656624] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.656887] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.657365] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.657636] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.657747] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.657811] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.658061] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.658211] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.658253] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: adac9a54-9bb6-4368-a762-389898a52bd9 is going to be updated. [ 1111.693568] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.693865] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.693916] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.694161] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.694372] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.707272] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: adac9a54-9bb6-4368-a762-389898a52bd9 in Status: IN_PROGRESS for 2s [ 1111.820122] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5f0070b-6fd5-4e89-a697-f74b50d1833f taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.821675] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5f0070b-6fd5-4e89-a697-f74b50d1833f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.821805] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5f0070b-6fd5-4e89-a697-f74b50d1833f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.822221] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5f0070b-6fd5-4e89-a697-f74b50d1833f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.822445] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.822583] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.822668] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.822856] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.824065] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.824065] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5f0070b-6fd5-4e89-a697-f74b50d1833f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.824065] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5f0070b-6fd5-4e89-a697-f74b50d1833f taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.824065] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5f0070b-6fd5-4e89-a697-f74b50d1833f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.824065] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5f0070b-6fd5-4e89-a697-f74b50d1833f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.824065] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5f0070b-6fd5-4e89-a697-f74b50d1833f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.824065] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.824065] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.824065] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.824065] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.824426] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.824426] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5f0070b-6fd5-4e89-a697-f74b50d1833f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.824426] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e5f0070b-6fd5-4e89-a697-f74b50d1833f',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.866994] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.866994] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.866994] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.866994] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.866994] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.866994] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bdcc7a21-dd0d-4296-ac34-a880ea6123e7 is going to be updated. [ 1111.901899] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.902068] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.902068] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.902218] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.902430] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.914868] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bdcc7a21-dd0d-4296-ac34-a880ea6123e7 in Status: IN_PROGRESS for 2s [ 1112.331016] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e5f0070b-6fd5-4e89-a697-f74b50d1833f: rpc.has_security_group_logging(os_id): False [ 1112.354923] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.354923] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.354923] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.355262] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.355405] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.355772] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.355772] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.355934] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.356014] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.356115] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.356298] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.356417] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.356499] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.357759] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.357759] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.357759] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.357759] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.357759] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.357759] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.357759] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.357759] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e5f0070b-6fd5-4e89-a697-f74b50d1833f is going to be created. [ 1112.448405] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.448527] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.448527] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.448719] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.448908] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.463325] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e5f0070b-6fd5-4e89-a697-f74b50d1833f in Status: IN_PROGRESS for 2s [ 1112.507624] env[69232]: INFO networking_nsxv3.common.synchronization [None req-d4e43e33-d379-4524-b8ec-f4b75f3bdb49 None None] Enqueued Resource ID: b47c5e20-2016-45a1-9840-9e2d1184c88e with Priority: HIGHEST for action port [ 1112.508683] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b47c5e20-2016-45a1-9840-9e2d1184c88e with Priority: HIGHEST for action port [ 1112.509530] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-b47c5e20-2016-45a1-9840-9e2d1184c88e taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.509530] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b47c5e20-2016-45a1-9840-9e2d1184c88e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.509530] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b47c5e20-2016-45a1-9840-9e2d1184c88e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.509882] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b47c5e20-2016-45a1-9840-9e2d1184c88e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.509962] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b47c5e20-2016-45a1-9840-9e2d1184c88e',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.012369] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b47c5e20-2016-45a1-9840-9e2d1184c88e [ 1113.012797] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.013141] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.013141] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.013562] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.013562] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.013562] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b47c5e20-2016-45a1-9840-9e2d1184c88e already deleted. [ 1113.013562] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b47c5e20-2016-45a1-9840-9e2d1184c88e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.720251] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: adac9a54-9bb6-4368-a762-389898a52bd9 in Status: SUCCESS [ 1113.720924] env[69232]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: adac9a54-9bb6-4368-a762-389898a52bd9 deletion is rescheduled due to dependency. [ 1113.721545] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-adac9a54-9bb6-4368-a762-389898a52bd9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.925538] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bdcc7a21-dd0d-4296-ac34-a880ea6123e7 in Status: SUCCESS [ 1113.925756] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.474775] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e5f0070b-6fd5-4e89-a697-f74b50d1833f in Status: SUCCESS [ 1114.474775] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e5f0070b-6fd5-4e89-a697-f74b50d1833f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.629998] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock network-756 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.630239] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "network-756" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.630371] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "network-756" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.630648] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "network-756" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.630985] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.631263] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.631415] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.631704] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.631889] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.632156] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1114.632311] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] NeedRegenerationException {{(pid=69232) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1114.632455] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] no value, waiting for create lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1114.632595] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] value creation lock acquired {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1114.632738] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1114.632876] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Calling creation function for not-yet-present value {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1114.633061] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1114.656774] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1114.656994] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=69232) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1114.657221] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Released creation lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1114.657485] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "network-756" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.658122] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock port-e76ca577-0f98-4ad9-833f-9b213fd39eb8 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.658258] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "port-e76ca577-0f98-4ad9-833f-9b213fd39eb8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.658328] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "port-e76ca577-0f98-4ad9-833f-9b213fd39eb8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.660622] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "port-e76ca577-0f98-4ad9-833f-9b213fd39eb8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.662183] env[69232]: DEBUG networking_nsxv3.api.rpc [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e76ca577-0f98-4ad9-833f-9b213fd39eb8',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.993863] env[69232]: INFO networking_nsxv3.common.synchronization [req-92dd0d21-5f84-4a9b-b032-2e3259d73b3b req-6ee95fb7-c0a4-40e7-b0b4-b855e68062dd tempest-DeleteServersTestJSON-830271628 tempest-DeleteServersTestJSON-830271628-project-member] Enqueued Resource ID: 9f5186e6-2d35-4ccf-a8b4-749a0a872128 with Priority: HIGHEST for action security_group_members [ 1114.994463] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f5186e6-2d35-4ccf-a8b4-749a0a872128 with Priority: HIGHEST for action security_group_members [ 1114.994770] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f5186e6-2d35-4ccf-a8b4-749a0a872128 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.994899] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.994960] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.995209] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.995365] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.995465] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.995525] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.995670] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.995755] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.995854] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9f5186e6-2d35-4ccf-a8b4-749a0a872128',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.165878] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.166172] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.166311] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.166608] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.166762] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.166954] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Segment Port e76ca577-0f98-4ad9-833f-9b213fd39eb8 not found, creating... [ 1115.167223] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.167388] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.167512] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.167750] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.167953] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.168207] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.168370] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.168498] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.168727] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.168851] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.168997] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Resource: SegmentPort with ID: e76ca577-0f98-4ad9-833f-9b213fd39eb8 is going to be created. [ 1115.188520] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.188748] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.188887] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.189185] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.189430] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.189663] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "port-e76ca577-0f98-4ad9-833f-9b213fd39eb8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.307144] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock network-279 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.307351] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "network-279" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.307479] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "network-279" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.307755] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "network-279" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.308217] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.308431] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.308556] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.308785] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.308937] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.309174] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1115.309292] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] NeedRegenerationException {{(pid=69232) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1115.309403] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] no value, waiting for create lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1115.309512] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] value creation lock acquired {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1115.309624] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1115.309734] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Calling creation function for not-yet-present value {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1115.309868] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1115.329417] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1115.329599] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69232) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1115.329747] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Released creation lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1115.330080] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "network-279" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.330279] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock port-bc640ccf-5920-425e-a114-7ccdbc1c2432 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.330458] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "port-bc640ccf-5920-425e-a114-7ccdbc1c2432" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.330584] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "port-bc640ccf-5920-425e-a114-7ccdbc1c2432" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.330927] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "port-bc640ccf-5920-425e-a114-7ccdbc1c2432" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.331087] env[69232]: DEBUG networking_nsxv3.api.rpc [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bc640ccf-5920-425e-a114-7ccdbc1c2432',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.498615] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.499028] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.499028] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.499122] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.499155] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.499338] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.499437] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.499498] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.499655] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.499733] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.499818] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9f5186e6-2d35-4ccf-a8b4-749a0a872128 is going to be updated. [ 1115.535339] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.535567] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.535567] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.535786] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.535931] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.546989] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f5186e6-2d35-4ccf-a8b4-749a0a872128 in Status: IN_PROGRESS for 2s [ 1115.834773] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.836856] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.837324] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.837820] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.840044] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.840339] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Segment Port bc640ccf-5920-425e-a114-7ccdbc1c2432 not found, creating... [ 1115.840757] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.841081] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.841314] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.841735] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.842112] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.842524] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.842831] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.845019] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.845019] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.845019] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.845019] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Resource: SegmentPort with ID: bc640ccf-5920-425e-a114-7ccdbc1c2432 is going to be created. [ 1115.872310] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.872310] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.872310] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.872310] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.872310] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.872310] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "port-bc640ccf-5920-425e-a114-7ccdbc1c2432" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.967642] env[69232]: INFO networking_nsxv3.common.synchronization [req-f569f69a-b0ae-4ed9-b838-3629b43cc415 req-aff2028f-b135-42dc-b45a-efba3e41bfd4 service nova] Enqueued Resource ID: 20ba03af-aba0-4fe6-af1e-ea103067fcbe with Priority: HIGHEST for action security_group_rules [ 1115.967642] env[69232]: INFO networking_nsxv3.common.synchronization [req-f569f69a-b0ae-4ed9-b838-3629b43cc415 req-aff2028f-b135-42dc-b45a-efba3e41bfd4 service nova] Enqueued Resource ID: 20ba03af-aba0-4fe6-af1e-ea103067fcbe with Priority: HIGHEST for action security_group_members [ 1115.967642] env[69232]: INFO networking_nsxv3.common.synchronization [req-f569f69a-b0ae-4ed9-b838-3629b43cc415 req-aff2028f-b135-42dc-b45a-efba3e41bfd4 service nova] Enqueued Resource ID: e76ca577-0f98-4ad9-833f-9b213fd39eb8 with Priority: HIGHEST for action port [ 1115.967642] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20ba03af-aba0-4fe6-af1e-ea103067fcbe with Priority: HIGHEST for action security_group_rules [ 1115.967642] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20ba03af-aba0-4fe6-af1e-ea103067fcbe with Priority: HIGHEST for action security_group_members [ 1115.967642] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e76ca577-0f98-4ad9-833f-9b213fd39eb8 with Priority: HIGHEST for action port [ 1115.969145] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-20ba03af-aba0-4fe6-af1e-ea103067fcbe taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.969472] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-20ba03af-aba0-4fe6-af1e-ea103067fcbe" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.969679] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-20ba03af-aba0-4fe6-af1e-ea103067fcbe" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.970000] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-20ba03af-aba0-4fe6-af1e-ea103067fcbe" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.970310] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('20ba03af-aba0-4fe6-af1e-ea103067fcbe',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.973119] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-20ba03af-aba0-4fe6-af1e-ea103067fcbe taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.973119] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-20ba03af-aba0-4fe6-af1e-ea103067fcbe" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.973119] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-20ba03af-aba0-4fe6-af1e-ea103067fcbe" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.973119] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-20ba03af-aba0-4fe6-af1e-ea103067fcbe" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.973119] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.973119] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.973119] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.973119] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.973119] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.973119] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('20ba03af-aba0-4fe6-af1e-ea103067fcbe',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.978041] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-e76ca577-0f98-4ad9-833f-9b213fd39eb8 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.978041] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e76ca577-0f98-4ad9-833f-9b213fd39eb8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.978041] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e76ca577-0f98-4ad9-833f-9b213fd39eb8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.978041] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e76ca577-0f98-4ad9-833f-9b213fd39eb8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.978041] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e76ca577-0f98-4ad9-833f-9b213fd39eb8',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.482299] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-20ba03af-aba0-4fe6-af1e-ea103067fcbe taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.482299] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-20ba03af-aba0-4fe6-af1e-ea103067fcbe" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.482299] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('20ba03af-aba0-4fe6-af1e-ea103067fcbe',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.482299] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e76ca577-0f98-4ad9-833f-9b213fd39eb8 with status ACTIVE [ 1116.482299] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.482299] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.482299] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.482299] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.482299] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.482299] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.482299] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.482299] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.482299] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.482299] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.482833] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.482833] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.482833] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.482833] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.482833] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.482833] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e76ca577-0f98-4ad9-833f-9b213fd39eb8 is going to be updated. [ 1116.510970] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.511633] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.511633] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.511874] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.512025] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.512190] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e76ca577-0f98-4ad9-833f-9b213fd39eb8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.558443] env[69232]: INFO networking_nsxv3.common.synchronization [req-92dd0d21-5f84-4a9b-b032-2e3259d73b3b req-c747960a-4c3d-4b36-8cf6-d915e33ff64f service nova] Enqueued Resource ID: 9f5186e6-2d35-4ccf-a8b4-749a0a872128 with Priority: HIGHEST for action security_group_rules [ 1116.558443] env[69232]: INFO networking_nsxv3.common.synchronization [req-92dd0d21-5f84-4a9b-b032-2e3259d73b3b req-c747960a-4c3d-4b36-8cf6-d915e33ff64f service nova] Enqueued Resource ID: 9f5186e6-2d35-4ccf-a8b4-749a0a872128 with Priority: HIGHEST for action security_group_members [ 1116.558443] env[69232]: INFO networking_nsxv3.common.synchronization [req-92dd0d21-5f84-4a9b-b032-2e3259d73b3b req-c747960a-4c3d-4b36-8cf6-d915e33ff64f service nova] Enqueued Resource ID: bc640ccf-5920-425e-a114-7ccdbc1c2432 with Priority: HIGHEST for action port [ 1116.558443] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f5186e6-2d35-4ccf-a8b4-749a0a872128 with Priority: HIGHEST for action security_group_rules [ 1116.558840] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f5186e6-2d35-4ccf-a8b4-749a0a872128 with Priority: HIGHEST for action security_group_members [ 1116.559202] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc640ccf-5920-425e-a114-7ccdbc1c2432 with Priority: HIGHEST for action port [ 1116.559781] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9f5186e6-2d35-4ccf-a8b4-749a0a872128 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.560260] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.560528] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.560936] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.561462] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9f5186e6-2d35-4ccf-a8b4-749a0a872128',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.562507] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f5186e6-2d35-4ccf-a8b4-749a0a872128 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.563075] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.563418] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-bc640ccf-5920-425e-a114-7ccdbc1c2432 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.564416] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bc640ccf-5920-425e-a114-7ccdbc1c2432" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.564416] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bc640ccf-5920-425e-a114-7ccdbc1c2432" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.565601] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bc640ccf-5920-425e-a114-7ccdbc1c2432" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.565878] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bc640ccf-5920-425e-a114-7ccdbc1c2432',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.987311] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('20ba03af-aba0-4fe6-af1e-ea103067fcbe',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.067400] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f5186e6-2d35-4ccf-a8b4-749a0a872128 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.067501] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.068824] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bc640ccf-5920-425e-a114-7ccdbc1c2432 with status ACTIVE [ 1117.069051] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.069169] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.069230] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.069441] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.069533] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.070212] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.070212] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.070212] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.070212] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.070212] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.070520] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.070520] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.070520] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.070520] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.070803] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.070803] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bc640ccf-5920-425e-a114-7ccdbc1c2432 is going to be updated. [ 1117.093397] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.093548] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.093613] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.093992] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.094173] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.094333] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bc640ccf-5920-425e-a114-7ccdbc1c2432" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.490457] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.490650] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.490752] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.490900] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.490995] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.491104] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 20ba03af-aba0-4fe6-af1e-ea103067fcbe is going to be updated. [ 1117.523833] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.524178] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.524178] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.524334] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.524499] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.534202] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 20ba03af-aba0-4fe6-af1e-ea103067fcbe in Status: IN_PROGRESS for 2s [ 1117.558513] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f5186e6-2d35-4ccf-a8b4-749a0a872128 in Status: SUCCESS [ 1117.558703] env[69232]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9f5186e6-2d35-4ccf-a8b4-749a0a872128 deletion is rescheduled due to dependency. [ 1117.558765] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.558929] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.559166] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.559351] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.559493] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.559589] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.559667] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.559741] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.559822] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9f5186e6-2d35-4ccf-a8b4-749a0a872128',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.766582] env[69232]: INFO networking_nsxv3.common.synchronization [req-54adaf8d-a772-4cb0-9c1d-dac867adfc5b req-86ef5943-1cf6-4f52-832b-4ca0edb3ed87 tempest-ServerRescueTestJSONUnderV235-1807184072 tempest-ServerRescueTestJSONUnderV235-1807184072-project-member] Enqueued Resource ID: 16f72037-6840-4564-b3d3-94bf5ff60708 with Priority: HIGHEST for action security_group_members [ 1117.766770] env[69232]: INFO networking_nsxv3.common.synchronization [req-54adaf8d-a772-4cb0-9c1d-dac867adfc5b req-86ef5943-1cf6-4f52-832b-4ca0edb3ed87 tempest-ServerRescueTestJSONUnderV235-1807184072 tempest-ServerRescueTestJSONUnderV235-1807184072-project-member] Enqueued Resource ID: d0bd446a-3904-4be9-a57d-247220321d48 with Priority: HIGHEST for action security_group_members [ 1117.767585] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16f72037-6840-4564-b3d3-94bf5ff60708 with Priority: HIGHEST for action security_group_members [ 1117.767585] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0bd446a-3904-4be9-a57d-247220321d48 with Priority: HIGHEST for action security_group_members [ 1117.767788] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-16f72037-6840-4564-b3d3-94bf5ff60708 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.767999] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16f72037-6840-4564-b3d3-94bf5ff60708" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.767999] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16f72037-6840-4564-b3d3-94bf5ff60708" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.768183] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16f72037-6840-4564-b3d3-94bf5ff60708" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.768394] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.768516] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.768586] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.768774] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.769207] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.769207] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('16f72037-6840-4564-b3d3-94bf5ff60708',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.769969] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0bd446a-3904-4be9-a57d-247220321d48 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.770092] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0bd446a-3904-4be9-a57d-247220321d48" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.770242] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0bd446a-3904-4be9-a57d-247220321d48" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.770490] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0bd446a-3904-4be9-a57d-247220321d48" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.770611] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.770732] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.770930] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.771130] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.771236] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.771344] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d0bd446a-3904-4be9-a57d-247220321d48',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.811328] env[69232]: INFO networking_nsxv3.common.synchronization [req-54adaf8d-a772-4cb0-9c1d-dac867adfc5b req-86ef5943-1cf6-4f52-832b-4ca0edb3ed87 tempest-ServerRescueTestJSONUnderV235-1807184072 tempest-ServerRescueTestJSONUnderV235-1807184072-project-member] Enqueued Resource ID: 16f72037-6840-4564-b3d3-94bf5ff60708 with Priority: HIGHEST for action security_group_rules [ 1117.811481] env[69232]: INFO networking_nsxv3.common.synchronization [req-54adaf8d-a772-4cb0-9c1d-dac867adfc5b req-86ef5943-1cf6-4f52-832b-4ca0edb3ed87 tempest-ServerRescueTestJSONUnderV235-1807184072 tempest-ServerRescueTestJSONUnderV235-1807184072-project-member] Enqueued Resource ID: 16f72037-6840-4564-b3d3-94bf5ff60708 with Priority: HIGHEST for action security_group_members [ 1117.811655] env[69232]: INFO networking_nsxv3.common.synchronization [req-54adaf8d-a772-4cb0-9c1d-dac867adfc5b req-86ef5943-1cf6-4f52-832b-4ca0edb3ed87 tempest-ServerRescueTestJSONUnderV235-1807184072 tempest-ServerRescueTestJSONUnderV235-1807184072-project-member] Enqueued Resource ID: d0bd446a-3904-4be9-a57d-247220321d48 with Priority: HIGHEST for action security_group_rules [ 1117.811829] env[69232]: INFO networking_nsxv3.common.synchronization [req-54adaf8d-a772-4cb0-9c1d-dac867adfc5b req-86ef5943-1cf6-4f52-832b-4ca0edb3ed87 tempest-ServerRescueTestJSONUnderV235-1807184072 tempest-ServerRescueTestJSONUnderV235-1807184072-project-member] Enqueued Resource ID: d0bd446a-3904-4be9-a57d-247220321d48 with Priority: HIGHEST for action security_group_members [ 1117.811972] env[69232]: INFO networking_nsxv3.common.synchronization [req-54adaf8d-a772-4cb0-9c1d-dac867adfc5b req-86ef5943-1cf6-4f52-832b-4ca0edb3ed87 tempest-ServerRescueTestJSONUnderV235-1807184072 tempest-ServerRescueTestJSONUnderV235-1807184072-project-member] Enqueued Resource ID: 6bb4e96d-1c12-4deb-81b2-4120928b5401 with Priority: HIGHEST for action port [ 1117.812438] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16f72037-6840-4564-b3d3-94bf5ff60708 with Priority: HIGHEST for action security_group_rules [ 1117.812569] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0bd446a-3904-4be9-a57d-247220321d48 with Priority: HIGHEST for action security_group_rules [ 1117.812666] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6bb4e96d-1c12-4deb-81b2-4120928b5401 with Priority: HIGHEST for action port [ 1117.812759] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16f72037-6840-4564-b3d3-94bf5ff60708 with Priority: HIGHEST for action security_group_members [ 1117.812845] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0bd446a-3904-4be9-a57d-247220321d48 with Priority: HIGHEST for action security_group_members [ 1117.813385] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-16f72037-6840-4564-b3d3-94bf5ff60708 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.813567] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-16f72037-6840-4564-b3d3-94bf5ff60708" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.813656] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-16f72037-6840-4564-b3d3-94bf5ff60708" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.813943] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-16f72037-6840-4564-b3d3-94bf5ff60708" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.814061] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('16f72037-6840-4564-b3d3-94bf5ff60708',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.815973] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d0bd446a-3904-4be9-a57d-247220321d48 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.816704] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d0bd446a-3904-4be9-a57d-247220321d48" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.816704] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d0bd446a-3904-4be9-a57d-247220321d48" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.816704] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d0bd446a-3904-4be9-a57d-247220321d48" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.816704] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d0bd446a-3904-4be9-a57d-247220321d48',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.818225] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-6bb4e96d-1c12-4deb-81b2-4120928b5401 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.818225] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6bb4e96d-1c12-4deb-81b2-4120928b5401" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.818225] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6bb4e96d-1c12-4deb-81b2-4120928b5401" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.818225] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6bb4e96d-1c12-4deb-81b2-4120928b5401" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.818225] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6bb4e96d-1c12-4deb-81b2-4120928b5401',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.818576] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-16f72037-6840-4564-b3d3-94bf5ff60708 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.818576] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16f72037-6840-4564-b3d3-94bf5ff60708" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.818640] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0bd446a-3904-4be9-a57d-247220321d48 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.818675] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0bd446a-3904-4be9-a57d-247220321d48" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.062378] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9f5186e6-2d35-4ccf-a8b4-749a0a872128',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.273373] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('16f72037-6840-4564-b3d3-94bf5ff60708',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.274388] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d0bd446a-3904-4be9-a57d-247220321d48',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.320307] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-16f72037-6840-4564-b3d3-94bf5ff60708 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.320528] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16f72037-6840-4564-b3d3-94bf5ff60708" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.320687] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0bd446a-3904-4be9-a57d-247220321d48 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.320776] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0bd446a-3904-4be9-a57d-247220321d48" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.320991] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6bb4e96d-1c12-4deb-81b2-4120928b5401 with status ACTIVE [ 1118.321232] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.321376] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.321464] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.321770] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.321900] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.322152] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.322302] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.322676] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.322676] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.322676] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.322882] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.323009] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.323118] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.323278] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.323357] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.323445] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6bb4e96d-1c12-4deb-81b2-4120928b5401 is going to be updated. [ 1118.344999] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.345153] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.345301] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.345435] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.345677] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.345776] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6bb4e96d-1c12-4deb-81b2-4120928b5401" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.564755] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9f5186e6-2d35-4ccf-a8b4-749a0a872128',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.641826] env[69232]: INFO networking_nsxv3.common.synchronization [req-2e0cceec-ccfa-44bb-b4b4-5bb6fd602ef8 req-14b0abeb-3be7-4cf3-b4c0-6978ee45bd9d tempest-ServerRescueTestJSONUnderV235-1807184072 tempest-ServerRescueTestJSONUnderV235-1807184072-project-member] Enqueued Resource ID: 16f72037-6840-4564-b3d3-94bf5ff60708 with Priority: HIGHEST for action security_group_members [ 1118.642295] env[69232]: INFO networking_nsxv3.common.synchronization [req-2e0cceec-ccfa-44bb-b4b4-5bb6fd602ef8 req-14b0abeb-3be7-4cf3-b4c0-6978ee45bd9d tempest-ServerRescueTestJSONUnderV235-1807184072 tempest-ServerRescueTestJSONUnderV235-1807184072-project-member] Enqueued Resource ID: d0bd446a-3904-4be9-a57d-247220321d48 with Priority: HIGHEST for action security_group_members [ 1118.642619] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16f72037-6840-4564-b3d3-94bf5ff60708 with Priority: HIGHEST for action security_group_members [ 1118.642774] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0bd446a-3904-4be9-a57d-247220321d48 with Priority: HIGHEST for action security_group_members [ 1118.643055] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-16f72037-6840-4564-b3d3-94bf5ff60708 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.643196] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16f72037-6840-4564-b3d3-94bf5ff60708" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.643359] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0bd446a-3904-4be9-a57d-247220321d48 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.643464] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0bd446a-3904-4be9-a57d-247220321d48" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.690468] env[69232]: INFO networking_nsxv3.common.synchronization [req-2e0cceec-ccfa-44bb-b4b4-5bb6fd602ef8 req-14b0abeb-3be7-4cf3-b4c0-6978ee45bd9d tempest-ServerRescueTestJSONUnderV235-1807184072 tempest-ServerRescueTestJSONUnderV235-1807184072-project-member] Enqueued Resource ID: 16f72037-6840-4564-b3d3-94bf5ff60708 with Priority: HIGHEST for action security_group_rules [ 1118.690686] env[69232]: INFO networking_nsxv3.common.synchronization [req-2e0cceec-ccfa-44bb-b4b4-5bb6fd602ef8 req-14b0abeb-3be7-4cf3-b4c0-6978ee45bd9d tempest-ServerRescueTestJSONUnderV235-1807184072 tempest-ServerRescueTestJSONUnderV235-1807184072-project-member] Enqueued Resource ID: 16f72037-6840-4564-b3d3-94bf5ff60708 with Priority: HIGHEST for action security_group_members [ 1118.690848] env[69232]: INFO networking_nsxv3.common.synchronization [req-2e0cceec-ccfa-44bb-b4b4-5bb6fd602ef8 req-14b0abeb-3be7-4cf3-b4c0-6978ee45bd9d tempest-ServerRescueTestJSONUnderV235-1807184072 tempest-ServerRescueTestJSONUnderV235-1807184072-project-member] Enqueued Resource ID: 6bb4e96d-1c12-4deb-81b2-4120928b5401 with Priority: HIGHEST for action port [ 1118.691351] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16f72037-6840-4564-b3d3-94bf5ff60708 with Priority: HIGHEST for action security_group_rules [ 1118.691483] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16f72037-6840-4564-b3d3-94bf5ff60708 with Priority: HIGHEST for action security_group_members [ 1118.691634] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6bb4e96d-1c12-4deb-81b2-4120928b5401 with Priority: HIGHEST for action port [ 1118.692531] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-16f72037-6840-4564-b3d3-94bf5ff60708 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.692643] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-16f72037-6840-4564-b3d3-94bf5ff60708" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.692873] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-16f72037-6840-4564-b3d3-94bf5ff60708 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.692961] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16f72037-6840-4564-b3d3-94bf5ff60708" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.693167] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-6bb4e96d-1c12-4deb-81b2-4120928b5401 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.693276] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6bb4e96d-1c12-4deb-81b2-4120928b5401" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.693340] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6bb4e96d-1c12-4deb-81b2-4120928b5401" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.693950] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6bb4e96d-1c12-4deb-81b2-4120928b5401" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.694054] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6bb4e96d-1c12-4deb-81b2-4120928b5401',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.775754] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('16f72037-6840-4564-b3d3-94bf5ff60708',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.776696] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d0bd446a-3904-4be9-a57d-247220321d48',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.836515] env[69232]: INFO networking_nsxv3.common.synchronization [req-ac4c48f4-211b-4479-a31d-3778befadcb2 req-89d4d45c-73d6-4799-8182-af05bab01d00 tempest-InstanceActionsNegativeTestJSON-1908515503 tempest-InstanceActionsNegativeTestJSON-1908515503-project-member] Enqueued Resource ID: e5f0070b-6fd5-4e89-a697-f74b50d1833f with Priority: HIGHEST for action security_group_members [ 1118.837102] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5f0070b-6fd5-4e89-a697-f74b50d1833f with Priority: HIGHEST for action security_group_members [ 1118.837451] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5f0070b-6fd5-4e89-a697-f74b50d1833f taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.837586] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5f0070b-6fd5-4e89-a697-f74b50d1833f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.837657] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5f0070b-6fd5-4e89-a697-f74b50d1833f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.837859] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5f0070b-6fd5-4e89-a697-f74b50d1833f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.838019] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.838120] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.838180] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.838326] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.838408] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.838496] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e5f0070b-6fd5-4e89-a697-f74b50d1833f',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.068045] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.068192] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.068192] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.068381] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.068476] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.068573] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9f5186e6-2d35-4ccf-a8b4-749a0a872128 is going to be updated. [ 1119.099131] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.099302] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.099378] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.099586] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.099731] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.108902] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f5186e6-2d35-4ccf-a8b4-749a0a872128 in Status: IN_PROGRESS for 2s [ 1119.196777] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6bb4e96d-1c12-4deb-81b2-4120928b5401 with status ACTIVE [ 1119.197015] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.197159] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.197229] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.197466] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.197605] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.197879] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.197879] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.197879] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.198088] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.198088] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.198266] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.198391] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.198441] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.198550] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.198621] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.198702] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6bb4e96d-1c12-4deb-81b2-4120928b5401 is going to be updated. [ 1119.220127] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.220279] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.220352] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.220559] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.220696] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.220855] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6bb4e96d-1c12-4deb-81b2-4120928b5401" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.287134] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.287134] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.287134] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.287134] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.287134] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.287134] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 16f72037-6840-4564-b3d3-94bf5ff60708 is going to be updated. [ 1119.287134] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.287134] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.287134] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.287134] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.288266] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.288410] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d0bd446a-3904-4be9-a57d-247220321d48 is going to be created. [ 1119.340962] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.340962] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.340962] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.341381] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.341381] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.341381] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.341536] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.341648] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.341935] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.341935] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.342123] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e5f0070b-6fd5-4e89-a697-f74b50d1833f is going to be updated. [ 1119.344126] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.344302] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.344302] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.344449] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.344593] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.347037] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.347226] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.347226] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.347373] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.347510] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.369437] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16f72037-6840-4564-b3d3-94bf5ff60708 in Status: IN_PROGRESS for 2s [ 1119.375829] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d0bd446a-3904-4be9-a57d-247220321d48 in Status: UNINITIALIZED for 2s [ 1119.413230] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.413450] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.413450] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.413771] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.413921] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.434129] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5f0070b-6fd5-4e89-a697-f74b50d1833f in Status: IN_PROGRESS for 2s [ 1119.546179] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 20ba03af-aba0-4fe6-af1e-ea103067fcbe in Status: SUCCESS [ 1119.546179] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-20ba03af-aba0-4fe6-af1e-ea103067fcbe" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.546179] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-20ba03af-aba0-4fe6-af1e-ea103067fcbe" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.546315] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-20ba03af-aba0-4fe6-af1e-ea103067fcbe" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.546387] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.546506] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.546574] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.546759] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.546844] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.546931] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-20ba03af-aba0-4fe6-af1e-ea103067fcbe" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.547034] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('20ba03af-aba0-4fe6-af1e-ea103067fcbe',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.049260] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-20ba03af-aba0-4fe6-af1e-ea103067fcbe taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.049650] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-20ba03af-aba0-4fe6-af1e-ea103067fcbe" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.049650] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-20ba03af-aba0-4fe6-af1e-ea103067fcbe" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.049650] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-20ba03af-aba0-4fe6-af1e-ea103067fcbe" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.049852] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.049930] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.049930] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.050083] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.050236] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.050236] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-20ba03af-aba0-4fe6-af1e-ea103067fcbe" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.050417] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-20ba03af-aba0-4fe6-af1e-ea103067fcbe taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.050495] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-20ba03af-aba0-4fe6-af1e-ea103067fcbe" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.050527] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-20ba03af-aba0-4fe6-af1e-ea103067fcbe" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.050648] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-20ba03af-aba0-4fe6-af1e-ea103067fcbe" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.050793] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.050890] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.050933] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.051071] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.051149] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.051298] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-20ba03af-aba0-4fe6-af1e-ea103067fcbe" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.051298] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('20ba03af-aba0-4fe6-af1e-ea103067fcbe',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.553374] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 20ba03af-aba0-4fe6-af1e-ea103067fcbe: rpc.has_security_group_logging(os_id): False [ 1120.574147] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.574345] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.574469] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.574728] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.574841] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.575155] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.575288] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.575372] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.575576] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.575715] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.576184] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.576184] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.576184] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.576380] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.576380] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.576575] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.576670] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.576731] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.577107] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.577107] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.577107] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 20ba03af-aba0-4fe6-af1e-ea103067fcbe is going to be updated. [ 1120.647624] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.647825] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.647937] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.648226] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.648420] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.672849] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 20ba03af-aba0-4fe6-af1e-ea103067fcbe in Status: IN_PROGRESS for 2s [ 1121.122774] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f5186e6-2d35-4ccf-a8b4-749a0a872128 in Status: SUCCESS [ 1121.123113] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.123248] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.123452] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.123648] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.123848] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.123911] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.124101] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.124186] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.124272] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.124363] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9f5186e6-2d35-4ccf-a8b4-749a0a872128',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.381082] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16f72037-6840-4564-b3d3-94bf5ff60708 in Status: SUCCESS [ 1121.381082] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16f72037-6840-4564-b3d3-94bf5ff60708" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.381266] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16f72037-6840-4564-b3d3-94bf5ff60708" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.381409] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16f72037-6840-4564-b3d3-94bf5ff60708" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.381648] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.383027] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.383027] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.383027] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.383027] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.383027] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('16f72037-6840-4564-b3d3-94bf5ff60708',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.387806] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d0bd446a-3904-4be9-a57d-247220321d48 in Status: SUCCESS [ 1121.387806] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0bd446a-3904-4be9-a57d-247220321d48" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.387806] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0bd446a-3904-4be9-a57d-247220321d48" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.387806] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0bd446a-3904-4be9-a57d-247220321d48" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.387806] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.387806] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.387806] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.387806] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.387806] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.387806] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d0bd446a-3904-4be9-a57d-247220321d48',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.447469] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5f0070b-6fd5-4e89-a697-f74b50d1833f in Status: SUCCESS [ 1121.448322] env[69232]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e5f0070b-6fd5-4e89-a697-f74b50d1833f deletion is rescheduled due to dependency. [ 1121.448322] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5f0070b-6fd5-4e89-a697-f74b50d1833f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.626924] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f5186e6-2d35-4ccf-a8b4-749a0a872128 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.627149] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.627233] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.627461] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.627730] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.627730] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.627827] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.627926] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.628080] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.628139] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.628352] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f5186e6-2d35-4ccf-a8b4-749a0a872128 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.628450] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.628506] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.628653] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.628793] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.628881] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.628949] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.629082] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.629177] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.629265] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.629359] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9f5186e6-2d35-4ccf-a8b4-749a0a872128',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.889663] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('16f72037-6840-4564-b3d3-94bf5ff60708',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.890904] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.891088] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.891123] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.891334] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.891425] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.891608] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.891729] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.891796] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.891958] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.892056] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.892137] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d0bd446a-3904-4be9-a57d-247220321d48 is going to be deleted. [ 1121.928338] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.928495] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.928544] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.928756] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.928850] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.928954] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0bd446a-3904-4be9-a57d-247220321d48" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.929122] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0bd446a-3904-4be9-a57d-247220321d48" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.929282] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0bd446a-3904-4be9-a57d-247220321d48" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.929480] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.929616] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.929616] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.929737] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.929801] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.929888] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d0bd446a-3904-4be9-a57d-247220321d48',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.132301] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9f5186e6-2d35-4ccf-a8b4-749a0a872128: rpc.has_security_group_logging(os_id): False [ 1122.151617] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.151793] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.151881] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.152109] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.152211] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.152412] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.152511] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.152574] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.152740] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.152813] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.153041] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.153152] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.153212] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.153359] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.153434] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.153630] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.153724] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.153818] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.153950] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.155080] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.155218] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9f5186e6-2d35-4ccf-a8b4-749a0a872128 is going to be updated. [ 1122.240664] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.240844] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.240908] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.242024] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.242024] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.263188] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9f5186e6-2d35-4ccf-a8b4-749a0a872128 in Status: IN_PROGRESS for 2s [ 1122.397021] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('16f72037-6840-4564-b3d3-94bf5ff60708',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.433063] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.433224] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.433224] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.433802] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.433802] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.433802] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.433802] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.434052] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.434052] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.434117] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.434149] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d0bd446a-3904-4be9-a57d-247220321d48 already deleted. [ 1122.434236] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0bd446a-3904-4be9-a57d-247220321d48" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.434340] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d0bd446a-3904-4be9-a57d-247220321d48',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.435380] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0bd446a-3904-4be9-a57d-247220321d48" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.435380] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0bd446a-3904-4be9-a57d-247220321d48" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.435544] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.435642] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.435711] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.435851] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.435930] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.437650] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d0bd446a-3904-4be9-a57d-247220321d48',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.623289] env[69232]: INFO networking_nsxv3.common.synchronization [None req-fe77bd93-0dc8-42c7-ac78-ea2ec746b8dd tempest-AttachVolumeNegativeTest-731570695 tempest-AttachVolumeNegativeTest-731570695-project-member] Enqueued Resource ID: 7ee2b034-ee73-4fda-89fe-97d3d457cb9f with Priority: HIGHEST for action security_group_rules [ 1122.623844] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ee2b034-ee73-4fda-89fe-97d3d457cb9f with Priority: HIGHEST for action security_group_rules [ 1122.624338] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7ee2b034-ee73-4fda-89fe-97d3d457cb9f taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.624494] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7ee2b034-ee73-4fda-89fe-97d3d457cb9f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.624564] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7ee2b034-ee73-4fda-89fe-97d3d457cb9f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.624933] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7ee2b034-ee73-4fda-89fe-97d3d457cb9f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.625091] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7ee2b034-ee73-4fda-89fe-97d3d457cb9f',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.689506] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 20ba03af-aba0-4fe6-af1e-ea103067fcbe in Status: SUCCESS [ 1122.689746] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-20ba03af-aba0-4fe6-af1e-ea103067fcbe" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.756516] env[69232]: INFO networking_nsxv3.common.synchronization [None req-4467bb06-9f1e-429d-af8f-974840e4e502 tempest-AttachVolumeNegativeTest-731570695 tempest-AttachVolumeNegativeTest-731570695-project-member] Enqueued Resource ID: 7ee2b034-ee73-4fda-89fe-97d3d457cb9f with Priority: HIGHEST for action security_group_rules [ 1122.757060] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ee2b034-ee73-4fda-89fe-97d3d457cb9f with Priority: HIGHEST for action security_group_rules [ 1122.757373] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7ee2b034-ee73-4fda-89fe-97d3d457cb9f taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.757471] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7ee2b034-ee73-4fda-89fe-97d3d457cb9f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.899015] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.899219] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.899277] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.899491] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.899583] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.899681] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 16f72037-6840-4564-b3d3-94bf5ff60708 is going to be updated. [ 1122.933669] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.933863] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.933927] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.934133] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.934282] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.940045] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d0bd446a-3904-4be9-a57d-247220321d48',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.941106] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.941245] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.941300] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.941495] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.941574] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.941775] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.941877] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.941940] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.942115] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.942192] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.942316] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d0bd446a-3904-4be9-a57d-247220321d48 already deleted. [ 1122.942446] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0bd446a-3904-4be9-a57d-247220321d48" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.944065] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16f72037-6840-4564-b3d3-94bf5ff60708 in Status: IN_PROGRESS for 2s [ 1123.146901] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.147291] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.147291] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.147368] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.147435] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.147534] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7ee2b034-ee73-4fda-89fe-97d3d457cb9f already deleted. [ 1123.147619] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7ee2b034-ee73-4fda-89fe-97d3d457cb9f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.147777] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7ee2b034-ee73-4fda-89fe-97d3d457cb9f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.147937] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7ee2b034-ee73-4fda-89fe-97d3d457cb9f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.148029] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7ee2b034-ee73-4fda-89fe-97d3d457cb9f',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.446039] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d0bd446a-3904-4be9-a57d-247220321d48: rpc.has_security_group_logging(os_id): False [ 1123.463880] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.464151] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.464151] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.464391] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.465341] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.465341] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.465341] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.465341] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.465341] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.465341] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.465341] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d0bd446a-3904-4be9-a57d-247220321d48 is going to be created. [ 1123.484535] env[69232]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/d0bd446a-3904-4be9-a57d-247220321d48], does not exist path=[/infra/domains/default/groups/d0bd446a-3904-4be9-a57d-247220321d48]."\n}' [ 1123.484678] env[69232]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d0bd446a-3904-4be9-a57d-247220321d48 failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/d0bd446a-3904-4be9-a57d-247220321d48 [ 1123.484762] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1123.527246] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.527246] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.527246] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.527556] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.529987] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.530350] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.530464] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.530517] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.530682] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.530763] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.530999] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.531110] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.531179] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.531332] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.531406] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.531499] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d0bd446a-3904-4be9-a57d-247220321d48 is going to be created. [ 1123.561492] env[69232]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/d0bd446a-3904-4be9-a57d-247220321d48], does not exist path=[/infra/domains/default/groups/d0bd446a-3904-4be9-a57d-247220321d48]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/d0bd446a-3904-4be9-a57d-247220321d48 [ 1123.561672] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d0bd446a-3904-4be9-a57d-247220321d48" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.561926] env[69232]: Traceback (most recent call last): [ 1123.561926] env[69232]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 1123.561926] env[69232]: return func(*args, **kwargs) [ 1123.561926] env[69232]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 1123.561926] env[69232]: res.raise_for_status() [ 1123.561926] env[69232]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 1123.561926] env[69232]: raise HTTPError(http_error_msg, response=self) [ 1123.561926] env[69232]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/d0bd446a-3904-4be9-a57d-247220321d48 [ 1123.562240] env[69232]: During handling of the above exception, another exception occurred: [ 1123.562240] env[69232]: Traceback (most recent call last): [ 1123.562240] env[69232]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 1123.562240] env[69232]: listener.cb(fileno) [ 1123.562240] env[69232]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 1123.562240] env[69232]: result = function(*args, **kwargs) [ 1123.562240] env[69232]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 1123.562240] env[69232]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 1123.562240] env[69232]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 1123.562240] env[69232]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 1123.562240] env[69232]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 1123.562240] env[69232]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 1123.562240] env[69232]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 1123.562240] env[69232]: res.raise_for_status() [ 1123.562240] env[69232]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 1123.562240] env[69232]: raise HTTPError(http_error_msg, response=self) [ 1123.562240] env[69232]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/d0bd446a-3904-4be9-a57d-247220321d48 [ 1123.562240] env[69232]: Removing descriptor: 23 [ 1123.677504] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.677688] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.677815] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.678052] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.678203] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.678406] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7ee2b034-ee73-4fda-89fe-97d3d457cb9f already deleted. [ 1123.678570] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7ee2b034-ee73-4fda-89fe-97d3d457cb9f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.286431] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9f5186e6-2d35-4ccf-a8b4-749a0a872128 in Status: SUCCESS [ 1124.286431] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.954515] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16f72037-6840-4564-b3d3-94bf5ff60708 in Status: SUCCESS [ 1124.954780] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16f72037-6840-4564-b3d3-94bf5ff60708" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.955040] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16f72037-6840-4564-b3d3-94bf5ff60708" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.955269] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16f72037-6840-4564-b3d3-94bf5ff60708" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.955459] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.955576] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.955642] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.955794] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.955878] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.955962] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16f72037-6840-4564-b3d3-94bf5ff60708" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.956092] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('16f72037-6840-4564-b3d3-94bf5ff60708',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.956954] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16f72037-6840-4564-b3d3-94bf5ff60708" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.957137] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16f72037-6840-4564-b3d3-94bf5ff60708" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.957289] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.957389] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.957451] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.957589] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.957664] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.957750] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('16f72037-6840-4564-b3d3-94bf5ff60708',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.459807] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-16f72037-6840-4564-b3d3-94bf5ff60708 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.460215] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16f72037-6840-4564-b3d3-94bf5ff60708" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.462322] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('16f72037-6840-4564-b3d3-94bf5ff60708',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.965458] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('16f72037-6840-4564-b3d3-94bf5ff60708',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.019497] env[69232]: INFO networking_nsxv3.common.synchronization [req-385c0c5d-93ed-4f53-b850-8a7e1d7ab36f req-ca2ea0ad-0dd3-44a0-8ad1-112bb45721f9 tempest-ServerRescueTestJSONUnderV235-1807184072 tempest-ServerRescueTestJSONUnderV235-1807184072-project-member] Enqueued Resource ID: 16f72037-6840-4564-b3d3-94bf5ff60708 with Priority: HIGHEST for action security_group_members [ 1126.020081] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16f72037-6840-4564-b3d3-94bf5ff60708 with Priority: HIGHEST for action security_group_members [ 1126.020400] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-16f72037-6840-4564-b3d3-94bf5ff60708 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.020511] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16f72037-6840-4564-b3d3-94bf5ff60708" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.467917] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.468231] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.468231] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.468407] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.468570] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.468687] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 16f72037-6840-4564-b3d3-94bf5ff60708 is going to be updated. [ 1126.503862] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.503862] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.503862] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.503862] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.503862] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.517129] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16f72037-6840-4564-b3d3-94bf5ff60708 in Status: IN_PROGRESS for 2s [ 1127.107958] env[69232]: INFO networking_nsxv3.common.synchronization [req-638d5b89-3b3a-46ea-806f-d8a81c9b6e5d req-036ff42b-c337-4cfb-a7fd-bcf0acee678a tempest-ServerActionsTestOtherB-650813181 tempest-ServerActionsTestOtherB-650813181-project-member] Enqueued Resource ID: 934b2684-b99c-4846-87df-66cbae10f2fc with Priority: HIGHEST for action security_group_members [ 1127.108442] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 934b2684-b99c-4846-87df-66cbae10f2fc with Priority: HIGHEST for action security_group_members [ 1127.109021] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-934b2684-b99c-4846-87df-66cbae10f2fc taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.109021] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-934b2684-b99c-4846-87df-66cbae10f2fc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.109130] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-934b2684-b99c-4846-87df-66cbae10f2fc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.109349] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-934b2684-b99c-4846-87df-66cbae10f2fc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.109525] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.109661] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.109705] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.110564] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.110564] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.110564] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('934b2684-b99c-4846-87df-66cbae10f2fc',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.614038] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.614038] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.614038] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.614433] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.795194] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.795544] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.795719] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.795863] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.797767] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.797767] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.797767] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 934b2684-b99c-4846-87df-66cbae10f2fc is going to be updated. [ 1127.827153] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.827153] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.827369] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.827478] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.827585] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.839133] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 934b2684-b99c-4846-87df-66cbae10f2fc in Status: IN_PROGRESS for 2s [ 1128.528981] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16f72037-6840-4564-b3d3-94bf5ff60708 in Status: SUCCESS [ 1128.530072] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16f72037-6840-4564-b3d3-94bf5ff60708" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.530277] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16f72037-6840-4564-b3d3-94bf5ff60708" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.530537] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16f72037-6840-4564-b3d3-94bf5ff60708" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.530777] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.530930] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.530995] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.531204] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.531307] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.531467] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('16f72037-6840-4564-b3d3-94bf5ff60708',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.035525] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.035917] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.035917] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.036149] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.059240] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.059240] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.059240] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.059240] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.059240] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.059240] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.059532] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 16f72037-6840-4564-b3d3-94bf5ff60708 is going to be updated. [ 1129.092493] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.092493] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.092674] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.092772] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.092912] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.101149] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16f72037-6840-4564-b3d3-94bf5ff60708 in Status: IN_PROGRESS for 2s [ 1129.782561] env[69232]: INFO networking_nsxv3.common.synchronization [req-ae49cdc8-70dc-469b-9496-2532c0e1eb41 req-80f06ef8-85c7-4405-be33-3d61a3ea46d3 tempest-ListServersNegativeTestJSON-1485357193 tempest-ListServersNegativeTestJSON-1485357193-project-member] Enqueued Resource ID: 714a2506-914c-4860-b68b-819348f723d0 with Priority: HIGHEST for action security_group_members [ 1129.782561] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 714a2506-914c-4860-b68b-819348f723d0 with Priority: HIGHEST for action security_group_members [ 1129.782561] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-714a2506-914c-4860-b68b-819348f723d0 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.782561] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-714a2506-914c-4860-b68b-819348f723d0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.782561] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-714a2506-914c-4860-b68b-819348f723d0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.782561] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-714a2506-914c-4860-b68b-819348f723d0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.789298] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.789298] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.789298] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.789298] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.789298] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.789298] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('714a2506-914c-4860-b68b-819348f723d0',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.848912] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 934b2684-b99c-4846-87df-66cbae10f2fc in Status: SUCCESS [ 1129.849121] env[69232]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 934b2684-b99c-4846-87df-66cbae10f2fc deletion is rescheduled due to dependency. [ 1129.851175] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-934b2684-b99c-4846-87df-66cbae10f2fc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.290333] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.290662] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.290662] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.290824] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.290824] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.291040] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.291181] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.291290] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.291436] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.291531] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.291637] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 714a2506-914c-4860-b68b-819348f723d0 already deleted. [ 1130.291756] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-714a2506-914c-4860-b68b-819348f723d0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.545054] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock network-112 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.545226] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "network-112" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.545295] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "network-112" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.545589] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "network-112" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.545883] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.546058] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.546191] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.546420] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.546594] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.546823] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1130.546990] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] NeedRegenerationException {{(pid=69232) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1130.547108] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] no value, waiting for create lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1130.547249] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] value creation lock acquired {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1130.547376] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1130.547492] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Calling creation function for not-yet-present value {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1130.547631] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1130.570281] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1130.570281] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69232) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1130.570435] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Released creation lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1130.570592] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "network-112" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.570975] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock port-bac7ea2b-b980-485a-99c5-842946e34987 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.571306] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "port-bac7ea2b-b980-485a-99c5-842946e34987" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.571306] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "port-bac7ea2b-b980-485a-99c5-842946e34987" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.571681] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "port-bac7ea2b-b980-485a-99c5-842946e34987" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.571891] env[69232]: DEBUG networking_nsxv3.api.rpc [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bac7ea2b-b980-485a-99c5-842946e34987',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.012103] env[69232]: INFO networking_nsxv3.common.synchronization [req-943702f3-2eea-401a-910b-79732240bd27 req-e338459c-dd90-4f80-84d9-ae086aeced88 tempest-DeleteServersTestJSON-830271628 tempest-DeleteServersTestJSON-830271628-project-member] Enqueued Resource ID: 9f5186e6-2d35-4ccf-a8b4-749a0a872128 with Priority: HIGHEST for action security_group_members [ 1131.012678] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f5186e6-2d35-4ccf-a8b4-749a0a872128 with Priority: HIGHEST for action security_group_members [ 1131.012966] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f5186e6-2d35-4ccf-a8b4-749a0a872128 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.013106] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.013186] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.013364] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.013513] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.013606] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.013661] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.013803] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.013907] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.014023] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9f5186e6-2d35-4ccf-a8b4-749a0a872128',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.075272] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.075543] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.075636] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.075924] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.076144] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.076295] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Segment Port bac7ea2b-b980-485a-99c5-842946e34987 not found, creating... [ 1131.076734] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.076734] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.076836] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.077081] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.077243] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.077541] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.077699] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.077815] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.078269] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.078472] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.078624] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Resource: SegmentPort with ID: bac7ea2b-b980-485a-99c5-842946e34987 is going to be created. [ 1131.102671] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.102987] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.103163] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.103544] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.103980] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.104342] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "port-bac7ea2b-b980-485a-99c5-842946e34987" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.116296] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16f72037-6840-4564-b3d3-94bf5ff60708 in Status: SUCCESS [ 1131.116577] env[69232]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 16f72037-6840-4564-b3d3-94bf5ff60708 deletion is rescheduled due to dependency. [ 1131.116750] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16f72037-6840-4564-b3d3-94bf5ff60708" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.117146] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16f72037-6840-4564-b3d3-94bf5ff60708" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.117488] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16f72037-6840-4564-b3d3-94bf5ff60708" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.117782] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.117978] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.118082] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.118253] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.118352] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.118454] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16f72037-6840-4564-b3d3-94bf5ff60708" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.118641] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-16f72037-6840-4564-b3d3-94bf5ff60708 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.118741] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16f72037-6840-4564-b3d3-94bf5ff60708" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.118854] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16f72037-6840-4564-b3d3-94bf5ff60708" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.118943] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16f72037-6840-4564-b3d3-94bf5ff60708" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.119114] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.119209] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.119452] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.119452] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.119580] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.119580] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16f72037-6840-4564-b3d3-94bf5ff60708" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.119667] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('16f72037-6840-4564-b3d3-94bf5ff60708',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.120543] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16f72037-6840-4564-b3d3-94bf5ff60708" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.120718] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16f72037-6840-4564-b3d3-94bf5ff60708" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.122037] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.122037] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.122037] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.122037] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.122037] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.122037] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('16f72037-6840-4564-b3d3-94bf5ff60708',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.516673] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.516993] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.516993] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.517309] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.622780] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 16f72037-6840-4564-b3d3-94bf5ff60708: rpc.has_security_group_logging(os_id): False [ 1131.625813] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.626018] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.636910] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.637186] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.637357] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.637357] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.637560] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.637639] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.637740] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9f5186e6-2d35-4ccf-a8b4-749a0a872128 is going to be updated. [ 1131.638697] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.638901] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.638965] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.639176] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.639308] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.639383] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.639479] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.639550] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.639633] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 16f72037-6840-4564-b3d3-94bf5ff60708 is going to be updated. [ 1131.641078] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.641190] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.641251] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.641400] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.641478] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.641653] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.641743] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.641816] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.641978] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.642094] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.642347] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.642347] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.642426] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.642525] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.642596] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.642778] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.642853] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.642908] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.643055] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.643130] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.643211] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 16f72037-6840-4564-b3d3-94bf5ff60708 is going to be updated. [ 1131.679460] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.679611] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.679705] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.679878] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.680030] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.681712] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.681817] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.681900] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.682267] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.682267] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.694538] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f5186e6-2d35-4ccf-a8b4-749a0a872128 in Status: IN_PROGRESS for 2s [ 1131.695400] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16f72037-6840-4564-b3d3-94bf5ff60708 in Status: IN_PROGRESS for 2s [ 1131.718558] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.719121] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.719121] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.719121] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.719121] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.733153] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 16f72037-6840-4564-b3d3-94bf5ff60708 in Status: IN_PROGRESS for 2s [ 1131.941241] env[69232]: INFO networking_nsxv3.common.synchronization [req-ae49cdc8-70dc-469b-9496-2532c0e1eb41 req-ab5717a2-ea2c-414c-b6ba-d880fc1bf35b service nova] Enqueued Resource ID: 714a2506-914c-4860-b68b-819348f723d0 with Priority: HIGHEST for action security_group_rules [ 1131.941749] env[69232]: INFO networking_nsxv3.common.synchronization [req-ae49cdc8-70dc-469b-9496-2532c0e1eb41 req-ab5717a2-ea2c-414c-b6ba-d880fc1bf35b service nova] Enqueued Resource ID: 714a2506-914c-4860-b68b-819348f723d0 with Priority: HIGHEST for action security_group_members [ 1131.941749] env[69232]: INFO networking_nsxv3.common.synchronization [req-ae49cdc8-70dc-469b-9496-2532c0e1eb41 req-ab5717a2-ea2c-414c-b6ba-d880fc1bf35b service nova] Enqueued Resource ID: bac7ea2b-b980-485a-99c5-842946e34987 with Priority: HIGHEST for action port [ 1131.941875] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 714a2506-914c-4860-b68b-819348f723d0 with Priority: HIGHEST for action security_group_rules [ 1131.941910] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 714a2506-914c-4860-b68b-819348f723d0 with Priority: HIGHEST for action security_group_members [ 1131.942034] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bac7ea2b-b980-485a-99c5-842946e34987 with Priority: HIGHEST for action port [ 1131.944072] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-714a2506-914c-4860-b68b-819348f723d0 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.944293] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-714a2506-914c-4860-b68b-819348f723d0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.944324] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-714a2506-914c-4860-b68b-819348f723d0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.944835] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-714a2506-914c-4860-b68b-819348f723d0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.944835] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('714a2506-914c-4860-b68b-819348f723d0',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.945558] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-714a2506-914c-4860-b68b-819348f723d0 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.945680] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-714a2506-914c-4860-b68b-819348f723d0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.945750] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-714a2506-914c-4860-b68b-819348f723d0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.945933] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-714a2506-914c-4860-b68b-819348f723d0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.946288] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.946288] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.946371] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.946463] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.946546] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.946637] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('714a2506-914c-4860-b68b-819348f723d0',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.947412] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-bac7ea2b-b980-485a-99c5-842946e34987 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.947517] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bac7ea2b-b980-485a-99c5-842946e34987" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.947581] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bac7ea2b-b980-485a-99c5-842946e34987" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.947728] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bac7ea2b-b980-485a-99c5-842946e34987" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.947799] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bac7ea2b-b980-485a-99c5-842946e34987',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.166810] env[69232]: INFO networking_nsxv3.common.synchronization [req-ae49cdc8-70dc-469b-9496-2532c0e1eb41 req-f42cfe3d-eb08-48ce-a263-88bca827efff tempest-ListServersNegativeTestJSON-1485357193 tempest-ListServersNegativeTestJSON-1485357193-project-member] Enqueued Resource ID: 714a2506-914c-4860-b68b-819348f723d0 with Priority: HIGHEST for action security_group_members [ 1132.167658] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 714a2506-914c-4860-b68b-819348f723d0 with Priority: HIGHEST for action security_group_members [ 1132.168201] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-714a2506-914c-4860-b68b-819348f723d0 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.168995] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-714a2506-914c-4860-b68b-819348f723d0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.449211] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-714a2506-914c-4860-b68b-819348f723d0 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.449418] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-714a2506-914c-4860-b68b-819348f723d0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.449537] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('714a2506-914c-4860-b68b-819348f723d0',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.450807] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bac7ea2b-b980-485a-99c5-842946e34987 with status ACTIVE [ 1132.451015] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.451135] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.451193] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.451396] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.451497] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.451673] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.451774] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.451840] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.452132] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.452216] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.452404] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.452528] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.456258] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.456258] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.456258] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.456258] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bac7ea2b-b980-485a-99c5-842946e34987 is going to be updated. [ 1132.475672] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.475938] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.475938] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.476700] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.476700] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.476700] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bac7ea2b-b980-485a-99c5-842946e34987" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.775764] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock network-112 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.776815] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "network-112" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.776815] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "network-112" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.778087] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "network-112" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.778087] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.778087] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.778087] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.778087] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.778087] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.778374] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1132.778374] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] NeedRegenerationException {{(pid=69232) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1132.778970] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] no value, waiting for create lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1132.778970] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] value creation lock acquired {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1132.778970] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1132.778970] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Calling creation function for not-yet-present value {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1132.778970] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1132.797992] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1132.798361] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69232) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1132.798638] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Released creation lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1132.798966] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "network-112" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.799469] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock port-9016686a-f73d-4896-a54e-bbf86e9a0200 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.799687] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "port-9016686a-f73d-4896-a54e-bbf86e9a0200" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.799822] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "port-9016686a-f73d-4896-a54e-bbf86e9a0200" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.800183] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "port-9016686a-f73d-4896-a54e-bbf86e9a0200" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.800330] env[69232]: DEBUG networking_nsxv3.api.rpc [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9016686a-f73d-4896-a54e-bbf86e9a0200',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.954754] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('714a2506-914c-4860-b68b-819348f723d0',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.303316] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.303536] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.303683] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.303986] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.304174] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.304386] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Segment Port 9016686a-f73d-4896-a54e-bbf86e9a0200 not found, creating... [ 1133.304687] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.304863] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.305739] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.306050] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.306270] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.306601] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.306769] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.306892] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.307138] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.307294] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.307430] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Resource: SegmentPort with ID: 9016686a-f73d-4896-a54e-bbf86e9a0200 is going to be created. [ 1133.329085] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.329341] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.329474] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.329757] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.330013] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.330261] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "port-9016686a-f73d-4896-a54e-bbf86e9a0200" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.457364] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.457598] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.457715] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.457995] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.458111] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.458217] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 714a2506-914c-4860-b68b-819348f723d0 is going to be created. [ 1133.486668] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.486853] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.486911] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.487182] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.487361] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.497650] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 714a2506-914c-4860-b68b-819348f723d0 in Status: UNINITIALIZED for 2s [ 1133.707039] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f5186e6-2d35-4ccf-a8b4-749a0a872128 in Status: SUCCESS [ 1133.707198] env[69232]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9f5186e6-2d35-4ccf-a8b4-749a0a872128 deletion is rescheduled due to dependency. [ 1133.707315] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.708087] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16f72037-6840-4564-b3d3-94bf5ff60708 in Status: SUCCESS [ 1133.708240] env[69232]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 16f72037-6840-4564-b3d3-94bf5ff60708 deletion is rescheduled due to dependency. [ 1133.708356] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16f72037-6840-4564-b3d3-94bf5ff60708" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.742545] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock network-756 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.742545] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "network-756" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.742652] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "network-756" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.742931] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "network-756" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.743209] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.743372] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.743493] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.743780] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.743964] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.744218] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1133.744340] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] NeedRegenerationException {{(pid=69232) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1133.744475] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] no value, waiting for create lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1133.744561] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] value creation lock acquired {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1133.744675] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1133.744784] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Calling creation function for not-yet-present value {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1133.744930] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1133.748138] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 16f72037-6840-4564-b3d3-94bf5ff60708 in Status: SUCCESS [ 1133.748370] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-16f72037-6840-4564-b3d3-94bf5ff60708" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.748862] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-16f72037-6840-4564-b3d3-94bf5ff60708" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.749095] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-16f72037-6840-4564-b3d3-94bf5ff60708" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.749147] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('16f72037-6840-4564-b3d3-94bf5ff60708',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.766052] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1133.767849] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69232) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1133.767849] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Released creation lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1133.767849] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "network-756" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.767849] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock port-e76ca577-0f98-4ad9-833f-9b213fd39eb8 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.767849] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "port-e76ca577-0f98-4ad9-833f-9b213fd39eb8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.767849] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "port-e76ca577-0f98-4ad9-833f-9b213fd39eb8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.768255] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "port-e76ca577-0f98-4ad9-833f-9b213fd39eb8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.768519] env[69232]: DEBUG networking_nsxv3.api.rpc [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e76ca577-0f98-4ad9-833f-9b213fd39eb8',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1134.131982] env[69232]: INFO networking_nsxv3.common.synchronization [req-ae49cdc8-70dc-469b-9496-2532c0e1eb41 req-f3e68db4-79fd-4c02-af99-b2dbccde6931 service nova] Enqueued Resource ID: 714a2506-914c-4860-b68b-819348f723d0 with Priority: HIGHEST for action security_group_rules [ 1134.132252] env[69232]: INFO networking_nsxv3.common.synchronization [req-ae49cdc8-70dc-469b-9496-2532c0e1eb41 req-f3e68db4-79fd-4c02-af99-b2dbccde6931 service nova] Enqueued Resource ID: 714a2506-914c-4860-b68b-819348f723d0 with Priority: HIGHEST for action security_group_members [ 1134.132388] env[69232]: INFO networking_nsxv3.common.synchronization [req-ae49cdc8-70dc-469b-9496-2532c0e1eb41 req-f3e68db4-79fd-4c02-af99-b2dbccde6931 service nova] Enqueued Resource ID: 9016686a-f73d-4896-a54e-bbf86e9a0200 with Priority: HIGHEST for action port [ 1134.132828] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 714a2506-914c-4860-b68b-819348f723d0 with Priority: HIGHEST for action security_group_rules [ 1134.132981] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 714a2506-914c-4860-b68b-819348f723d0 with Priority: HIGHEST for action security_group_members [ 1134.133093] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9016686a-f73d-4896-a54e-bbf86e9a0200 with Priority: HIGHEST for action port [ 1134.133382] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-714a2506-914c-4860-b68b-819348f723d0 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.137065] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-714a2506-914c-4860-b68b-819348f723d0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.137454] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-714a2506-914c-4860-b68b-819348f723d0 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.137540] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-714a2506-914c-4860-b68b-819348f723d0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.137726] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-9016686a-f73d-4896-a54e-bbf86e9a0200 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.137828] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9016686a-f73d-4896-a54e-bbf86e9a0200" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.137908] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9016686a-f73d-4896-a54e-bbf86e9a0200" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.138172] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9016686a-f73d-4896-a54e-bbf86e9a0200" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.138294] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9016686a-f73d-4896-a54e-bbf86e9a0200',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1134.271049] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.271049] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.271049] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.271302] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.271600] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.271744] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 16f72037-6840-4564-b3d3-94bf5ff60708 is going to be deleted. [ 1134.273105] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.273346] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.273480] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.274350] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.274658] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.275082] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.275276] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.275460] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.275782] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.275947] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.276407] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.276617] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.276766] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.277064] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.277264] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.277441] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Resource: SegmentPort with ID: e76ca577-0f98-4ad9-833f-9b213fd39eb8 is going to be updated. [ 1134.303879] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.304207] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.304357] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.304654] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.304946] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.305288] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "port-e76ca577-0f98-4ad9-833f-9b213fd39eb8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.335121] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.335709] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.335832] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.336196] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.336613] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.336817] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-16f72037-6840-4564-b3d3-94bf5ff60708" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.589555] env[69232]: INFO networking_nsxv3.common.synchronization [req-ae49cdc8-70dc-469b-9496-2532c0e1eb41 req-956dfafd-fa04-493d-88ba-0396909f994c tempest-ListServersNegativeTestJSON-1485357193 tempest-ListServersNegativeTestJSON-1485357193-project-member] Enqueued Resource ID: 714a2506-914c-4860-b68b-819348f723d0 with Priority: HIGHEST for action security_group_members [ 1134.590669] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 714a2506-914c-4860-b68b-819348f723d0 with Priority: HIGHEST for action security_group_members [ 1134.590669] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-714a2506-914c-4860-b68b-819348f723d0 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.590669] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-714a2506-914c-4860-b68b-819348f723d0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.643398] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9016686a-f73d-4896-a54e-bbf86e9a0200 with status ACTIVE [ 1134.643398] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.643398] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.643398] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.643398] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.643398] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.643398] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.643398] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.643398] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.643398] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.643398] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.643398] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.643398] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.643398] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.643398] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.643398] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.643398] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9016686a-f73d-4896-a54e-bbf86e9a0200 is going to be updated. [ 1134.664694] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.664694] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.664694] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.664694] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.664694] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.664694] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9016686a-f73d-4896-a54e-bbf86e9a0200" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.043025] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock network-112 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.043025] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "network-112" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.043025] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "network-112" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.043025] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "network-112" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.043025] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.043025] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.043025] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.043025] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.043025] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.043025] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1135.043648] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] NeedRegenerationException {{(pid=69232) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1135.043879] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] no value, waiting for create lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1135.044177] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] value creation lock acquired {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1135.044425] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1135.044638] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Calling creation function for not-yet-present value {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1135.044867] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1135.063864] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1135.064354] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69232) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1135.064633] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Released creation lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1135.064922] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "network-112" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.065378] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock port-b871e886-693d-4301-8b8f-42cf6124830a taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.065739] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "port-b871e886-693d-4301-8b8f-42cf6124830a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.066106] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "port-b871e886-693d-4301-8b8f-42cf6124830a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.067017] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "port-b871e886-693d-4301-8b8f-42cf6124830a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.067017] env[69232]: DEBUG networking_nsxv3.api.rpc [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b871e886-693d-4301-8b8f-42cf6124830a',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.117276] env[69232]: INFO networking_nsxv3.common.synchronization [req-d123e269-68f7-443e-937f-591b184dab7c req-8a1af8b0-273b-4ebf-a532-3cb121985692 service nova] Enqueued Resource ID: 20ba03af-aba0-4fe6-af1e-ea103067fcbe with Priority: HIGHEST for action security_group_rules [ 1135.117276] env[69232]: INFO networking_nsxv3.common.synchronization [req-d123e269-68f7-443e-937f-591b184dab7c req-8a1af8b0-273b-4ebf-a532-3cb121985692 service nova] Enqueued Resource ID: 20ba03af-aba0-4fe6-af1e-ea103067fcbe with Priority: HIGHEST for action security_group_members [ 1135.117276] env[69232]: INFO networking_nsxv3.common.synchronization [req-d123e269-68f7-443e-937f-591b184dab7c req-8a1af8b0-273b-4ebf-a532-3cb121985692 service nova] Enqueued Resource ID: e76ca577-0f98-4ad9-833f-9b213fd39eb8 with Priority: HIGHEST for action port [ 1135.117667] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20ba03af-aba0-4fe6-af1e-ea103067fcbe with Priority: HIGHEST for action security_group_rules [ 1135.117932] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20ba03af-aba0-4fe6-af1e-ea103067fcbe with Priority: HIGHEST for action security_group_members [ 1135.118633] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e76ca577-0f98-4ad9-833f-9b213fd39eb8 with Priority: HIGHEST for action port [ 1135.119189] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-20ba03af-aba0-4fe6-af1e-ea103067fcbe taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.119474] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-20ba03af-aba0-4fe6-af1e-ea103067fcbe" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.119690] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-20ba03af-aba0-4fe6-af1e-ea103067fcbe" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.120129] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-20ba03af-aba0-4fe6-af1e-ea103067fcbe" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.120333] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('20ba03af-aba0-4fe6-af1e-ea103067fcbe',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.121353] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-20ba03af-aba0-4fe6-af1e-ea103067fcbe taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.121610] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-20ba03af-aba0-4fe6-af1e-ea103067fcbe" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.121847] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-20ba03af-aba0-4fe6-af1e-ea103067fcbe" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.122276] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-20ba03af-aba0-4fe6-af1e-ea103067fcbe" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.122683] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.125690] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.125690] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.125690] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.125690] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.125690] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('20ba03af-aba0-4fe6-af1e-ea103067fcbe',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.125690] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-e76ca577-0f98-4ad9-833f-9b213fd39eb8 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.125690] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e76ca577-0f98-4ad9-833f-9b213fd39eb8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.125690] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e76ca577-0f98-4ad9-833f-9b213fd39eb8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.125690] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e76ca577-0f98-4ad9-833f-9b213fd39eb8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.125690] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e76ca577-0f98-4ad9-833f-9b213fd39eb8',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.509109] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 714a2506-914c-4860-b68b-819348f723d0 in Status: SUCCESS [ 1135.509527] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-714a2506-914c-4860-b68b-819348f723d0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.509527] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-714a2506-914c-4860-b68b-819348f723d0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.509684] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-714a2506-914c-4860-b68b-819348f723d0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.510179] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.510179] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.510179] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.510365] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.510365] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.510455] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('714a2506-914c-4860-b68b-819348f723d0',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.572526] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.572871] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.573052] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.573409] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.573669] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.573863] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Segment Port b871e886-693d-4301-8b8f-42cf6124830a not found, creating... [ 1135.574221] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.574405] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.574530] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.574823] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.574989] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.575428] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.575632] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.575747] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.575969] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.576126] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.576290] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Resource: SegmentPort with ID: b871e886-693d-4301-8b8f-42cf6124830a is going to be created. [ 1135.601317] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.601555] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.601688] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.601990] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.602254] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.602492] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "port-b871e886-693d-4301-8b8f-42cf6124830a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.625786] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('20ba03af-aba0-4fe6-af1e-ea103067fcbe',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.626908] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-20ba03af-aba0-4fe6-af1e-ea103067fcbe taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.627487] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-20ba03af-aba0-4fe6-af1e-ea103067fcbe" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.627942] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e76ca577-0f98-4ad9-833f-9b213fd39eb8 with status ACTIVE [ 1135.628295] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.628420] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.628486] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.628691] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.628779] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.628954] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.629120] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.629120] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.629279] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.629384] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.629546] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.629667] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.629756] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.629836] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.629910] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.630073] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e76ca577-0f98-4ad9-833f-9b213fd39eb8 is going to be updated. [ 1135.663075] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.663376] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.663376] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.663496] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.663702] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.664128] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e76ca577-0f98-4ad9-833f-9b213fd39eb8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.013146] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('714a2506-914c-4860-b68b-819348f723d0',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.129013] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('20ba03af-aba0-4fe6-af1e-ea103067fcbe',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.312331] env[69232]: INFO networking_nsxv3.common.synchronization [req-ae49cdc8-70dc-469b-9496-2532c0e1eb41 req-6c5dbf44-cf49-4345-a8d3-d1b56a913af5 service nova] Enqueued Resource ID: 714a2506-914c-4860-b68b-819348f723d0 with Priority: HIGHEST for action security_group_rules [ 1136.312466] env[69232]: INFO networking_nsxv3.common.synchronization [req-ae49cdc8-70dc-469b-9496-2532c0e1eb41 req-6c5dbf44-cf49-4345-a8d3-d1b56a913af5 service nova] Enqueued Resource ID: 714a2506-914c-4860-b68b-819348f723d0 with Priority: HIGHEST for action security_group_members [ 1136.312564] env[69232]: INFO networking_nsxv3.common.synchronization [req-ae49cdc8-70dc-469b-9496-2532c0e1eb41 req-6c5dbf44-cf49-4345-a8d3-d1b56a913af5 service nova] Enqueued Resource ID: b871e886-693d-4301-8b8f-42cf6124830a with Priority: HIGHEST for action port [ 1136.316625] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 714a2506-914c-4860-b68b-819348f723d0 with Priority: HIGHEST for action security_group_rules [ 1136.316625] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 714a2506-914c-4860-b68b-819348f723d0 with Priority: HIGHEST for action security_group_members [ 1136.316625] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b871e886-693d-4301-8b8f-42cf6124830a with Priority: HIGHEST for action port [ 1136.316625] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-714a2506-914c-4860-b68b-819348f723d0 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.316625] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-714a2506-914c-4860-b68b-819348f723d0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.316625] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-714a2506-914c-4860-b68b-819348f723d0 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.316625] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-714a2506-914c-4860-b68b-819348f723d0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.316625] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-b871e886-693d-4301-8b8f-42cf6124830a taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.316625] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b871e886-693d-4301-8b8f-42cf6124830a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.316625] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b871e886-693d-4301-8b8f-42cf6124830a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.316625] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b871e886-693d-4301-8b8f-42cf6124830a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.316625] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b871e886-693d-4301-8b8f-42cf6124830a',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.515556] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('714a2506-914c-4860-b68b-819348f723d0',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.632725] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.632991] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.632991] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.633289] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.633419] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.633526] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 20ba03af-aba0-4fe6-af1e-ea103067fcbe is going to be updated. [ 1136.667501] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.667684] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.667730] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.667929] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.668083] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.680861] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 20ba03af-aba0-4fe6-af1e-ea103067fcbe in Status: IN_PROGRESS for 2s [ 1136.818524] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b871e886-693d-4301-8b8f-42cf6124830a with status ACTIVE [ 1136.818999] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.819303] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.819437] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.819695] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.819838] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.821189] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.821189] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.821189] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.821189] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.821189] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.821189] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.821189] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.821189] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.821505] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.821505] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.821634] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b871e886-693d-4301-8b8f-42cf6124830a is going to be updated. [ 1136.844090] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.844225] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.844316] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.844630] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.844795] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.845065] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b871e886-693d-4301-8b8f-42cf6124830a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.018977] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.019150] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.019150] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.019477] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.019580] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.019691] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 714a2506-914c-4860-b68b-819348f723d0 is going to be updated. [ 1137.049745] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.049926] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.049982] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.050289] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.050452] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.064271] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 714a2506-914c-4860-b68b-819348f723d0 in Status: IN_PROGRESS for 2s [ 1138.692852] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 20ba03af-aba0-4fe6-af1e-ea103067fcbe in Status: SUCCESS [ 1138.693275] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-20ba03af-aba0-4fe6-af1e-ea103067fcbe" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.694192] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-20ba03af-aba0-4fe6-af1e-ea103067fcbe" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.696657] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-20ba03af-aba0-4fe6-af1e-ea103067fcbe" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.696934] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.697090] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.697163] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.697354] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.697441] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.697548] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-20ba03af-aba0-4fe6-af1e-ea103067fcbe" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.697663] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('20ba03af-aba0-4fe6-af1e-ea103067fcbe',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1139.076114] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 714a2506-914c-4860-b68b-819348f723d0 in Status: SUCCESS [ 1139.076412] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-714a2506-914c-4860-b68b-819348f723d0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.076412] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-714a2506-914c-4860-b68b-819348f723d0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.076635] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-714a2506-914c-4860-b68b-819348f723d0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.076861] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.077020] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.077020] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.077191] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.077270] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.077365] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-714a2506-914c-4860-b68b-819348f723d0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.077448] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('714a2506-914c-4860-b68b-819348f723d0',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1139.078338] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-714a2506-914c-4860-b68b-819348f723d0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.078506] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-714a2506-914c-4860-b68b-819348f723d0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.078680] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.078788] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.078865] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.079631] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.079722] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.079836] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('714a2506-914c-4860-b68b-819348f723d0',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1139.203024] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-20ba03af-aba0-4fe6-af1e-ea103067fcbe taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.203024] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-20ba03af-aba0-4fe6-af1e-ea103067fcbe" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.203024] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-20ba03af-aba0-4fe6-af1e-ea103067fcbe" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.203024] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-20ba03af-aba0-4fe6-af1e-ea103067fcbe" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.203024] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.203024] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.203024] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.203024] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.203024] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.203024] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-20ba03af-aba0-4fe6-af1e-ea103067fcbe" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.203024] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-20ba03af-aba0-4fe6-af1e-ea103067fcbe taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.203024] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-20ba03af-aba0-4fe6-af1e-ea103067fcbe" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.203024] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-20ba03af-aba0-4fe6-af1e-ea103067fcbe" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.203024] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-20ba03af-aba0-4fe6-af1e-ea103067fcbe" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.203024] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.203024] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.203705] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.203705] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.203705] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.203705] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-20ba03af-aba0-4fe6-af1e-ea103067fcbe" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.203705] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('20ba03af-aba0-4fe6-af1e-ea103067fcbe',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1139.310027] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock network-934 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.310027] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "network-934" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.310027] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "network-934" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.310027] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "network-934" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.311017] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.311017] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.311017] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.311017] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.311310] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.311310] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1139.311426] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] NeedRegenerationException {{(pid=69232) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1139.311543] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] no value, waiting for create lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1139.311658] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] value creation lock acquired {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1139.311775] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1139.311899] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Calling creation function for not-yet-present value {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1139.312092] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1139.331756] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1139.331906] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69232) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1139.332099] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Released creation lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1139.332323] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "network-934" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.332686] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock port-336a8c9c-5bd2-4bee-b674-6cb4b1129888 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.332878] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "port-336a8c9c-5bd2-4bee-b674-6cb4b1129888" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.333013] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "port-336a8c9c-5bd2-4bee-b674-6cb4b1129888" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.333299] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "port-336a8c9c-5bd2-4bee-b674-6cb4b1129888" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.333439] env[69232]: DEBUG networking_nsxv3.api.rpc [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('336a8c9c-5bd2-4bee-b674-6cb4b1129888',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1139.581508] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-714a2506-914c-4860-b68b-819348f723d0 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.581728] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-714a2506-914c-4860-b68b-819348f723d0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.583459] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('714a2506-914c-4860-b68b-819348f723d0',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1139.706782] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 20ba03af-aba0-4fe6-af1e-ea103067fcbe: rpc.has_security_group_logging(os_id): False [ 1139.726913] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.727305] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.727305] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.727444] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.747391] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.747795] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.748014] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.748103] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.748340] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.748474] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.748720] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.748855] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.748919] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.749140] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.749254] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.749469] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.749630] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.749703] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.749883] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.749964] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.750066] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 20ba03af-aba0-4fe6-af1e-ea103067fcbe is going to be updated. [ 1139.836390] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.836609] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.836727] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.837019] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.837273] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.837745] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.838017] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.838256] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.838588] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.838837] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.839327] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.839582] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.839834] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.840116] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.840365] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.840629] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Resource: SegmentPort with ID: 336a8c9c-5bd2-4bee-b674-6cb4b1129888 is going to be updated. [ 1139.843421] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.843603] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.843727] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.843999] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.844222] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.875691] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 20ba03af-aba0-4fe6-af1e-ea103067fcbe in Status: IN_PROGRESS for 2s [ 1139.880793] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.881213] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.881385] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.881683] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.882065] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.882388] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "port-336a8c9c-5bd2-4bee-b674-6cb4b1129888" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.086385] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('714a2506-914c-4860-b68b-819348f723d0',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.560159] env[69232]: INFO networking_nsxv3.common.synchronization [req-3bf1e748-d228-454b-8451-987990dc057a req-4179964e-99cd-40c9-9499-370bd8acc0b7 service nova] Enqueued Resource ID: 83d1cdee-a934-490e-9869-707c6882be9d with Priority: HIGHEST for action security_group_rules [ 1140.560227] env[69232]: INFO networking_nsxv3.common.synchronization [req-3bf1e748-d228-454b-8451-987990dc057a req-4179964e-99cd-40c9-9499-370bd8acc0b7 service nova] Enqueued Resource ID: 83d1cdee-a934-490e-9869-707c6882be9d with Priority: HIGHEST for action security_group_members [ 1140.560371] env[69232]: INFO networking_nsxv3.common.synchronization [req-3bf1e748-d228-454b-8451-987990dc057a req-4179964e-99cd-40c9-9499-370bd8acc0b7 service nova] Enqueued Resource ID: 336a8c9c-5bd2-4bee-b674-6cb4b1129888 with Priority: HIGHEST for action port [ 1140.560614] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83d1cdee-a934-490e-9869-707c6882be9d with Priority: HIGHEST for action security_group_rules [ 1140.560739] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83d1cdee-a934-490e-9869-707c6882be9d with Priority: HIGHEST for action security_group_members [ 1140.560836] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 336a8c9c-5bd2-4bee-b674-6cb4b1129888 with Priority: HIGHEST for action port [ 1140.561428] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-83d1cdee-a934-490e-9869-707c6882be9d taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.561555] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-83d1cdee-a934-490e-9869-707c6882be9d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.561621] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-83d1cdee-a934-490e-9869-707c6882be9d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.561822] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-83d1cdee-a934-490e-9869-707c6882be9d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.561926] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('83d1cdee-a934-490e-9869-707c6882be9d',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.563603] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-83d1cdee-a934-490e-9869-707c6882be9d taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.563751] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-83d1cdee-a934-490e-9869-707c6882be9d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.563846] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-83d1cdee-a934-490e-9869-707c6882be9d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.564159] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-83d1cdee-a934-490e-9869-707c6882be9d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.564350] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.564484] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.564572] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.564757] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.564878] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.565012] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('83d1cdee-a934-490e-9869-707c6882be9d',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.565971] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-336a8c9c-5bd2-4bee-b674-6cb4b1129888 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.566135] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-336a8c9c-5bd2-4bee-b674-6cb4b1129888" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.566245] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-336a8c9c-5bd2-4bee-b674-6cb4b1129888" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.566449] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-336a8c9c-5bd2-4bee-b674-6cb4b1129888" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.566565] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('336a8c9c-5bd2-4bee-b674-6cb4b1129888',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.588774] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.588985] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.589318] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.589618] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.589733] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.589843] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 714a2506-914c-4860-b68b-819348f723d0 is going to be updated. [ 1140.660861] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.661143] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.661288] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.661666] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.661976] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.673453] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 714a2506-914c-4860-b68b-819348f723d0 in Status: IN_PROGRESS for 2s [ 1141.068840] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-83d1cdee-a934-490e-9869-707c6882be9d taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.068840] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-83d1cdee-a934-490e-9869-707c6882be9d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.069418] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('83d1cdee-a934-490e-9869-707c6882be9d',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.070289] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 336a8c9c-5bd2-4bee-b674-6cb4b1129888 with status ACTIVE [ 1141.070552] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.070763] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.070866] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.072037] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.072037] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.072037] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.072037] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.072037] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.072037] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.072489] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.072489] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.072489] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.072489] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.072706] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.072706] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.072797] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 336a8c9c-5bd2-4bee-b674-6cb4b1129888 is going to be updated. [ 1141.096694] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.096919] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.096919] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.098179] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.098179] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.098179] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-336a8c9c-5bd2-4bee-b674-6cb4b1129888" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.574746] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('83d1cdee-a934-490e-9869-707c6882be9d',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.893137] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 20ba03af-aba0-4fe6-af1e-ea103067fcbe in Status: SUCCESS [ 1141.893367] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-20ba03af-aba0-4fe6-af1e-ea103067fcbe" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.077211] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.077590] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.077590] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.077657] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.077856] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.077856] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 83d1cdee-a934-490e-9869-707c6882be9d is going to be updated. [ 1142.110106] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.110288] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.110355] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.110532] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.110676] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.120648] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 83d1cdee-a934-490e-9869-707c6882be9d in Status: IN_PROGRESS for 2s [ 1142.231738] env[69232]: INFO networking_nsxv3.common.synchronization [req-eea8ea7d-823e-4ab6-9d8e-3c6d2db10b62 req-cfbdb617-0312-40c0-b89a-6d5c515b2b17 tempest-AttachVolumeNegativeTest-731570695 tempest-AttachVolumeNegativeTest-731570695-project-member] Enqueued Resource ID: 7ee2b034-ee73-4fda-89fe-97d3d457cb9f with Priority: HIGHEST for action security_group_members [ 1142.235632] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ee2b034-ee73-4fda-89fe-97d3d457cb9f with Priority: HIGHEST for action security_group_members [ 1142.236017] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ee2b034-ee73-4fda-89fe-97d3d457cb9f taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.236214] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ee2b034-ee73-4fda-89fe-97d3d457cb9f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.236294] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ee2b034-ee73-4fda-89fe-97d3d457cb9f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.236604] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ee2b034-ee73-4fda-89fe-97d3d457cb9f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.236823] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.236937] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.236999] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.237178] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.237264] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.237428] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7ee2b034-ee73-4fda-89fe-97d3d457cb9f',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.671966] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock network-55 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.672418] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "network-55" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.672418] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "network-55" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.672602] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "network-55" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.672871] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.673047] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.673169] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.673397] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.673575] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.673862] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1142.673929] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] NeedRegenerationException {{(pid=69232) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1142.674143] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] no value, waiting for create lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1142.674254] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] value creation lock acquired {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1142.674374] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1142.674506] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Calling creation function for not-yet-present value {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1142.674642] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1142.691855] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 714a2506-914c-4860-b68b-819348f723d0 in Status: SUCCESS [ 1142.691855] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-714a2506-914c-4860-b68b-819348f723d0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.692583] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-714a2506-914c-4860-b68b-819348f723d0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.692850] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-714a2506-914c-4860-b68b-819348f723d0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.693057] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.693166] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.693237] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.693380] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.693462] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.693555] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('714a2506-914c-4860-b68b-819348f723d0',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.699335] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1142.699609] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=69232) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1142.699692] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Released creation lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1142.699873] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "network-55" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.700248] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock port-6e7d0c6b-def8-4a0d-b86f-bde53bb3c21e taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.700446] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "port-6e7d0c6b-def8-4a0d-b86f-bde53bb3c21e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.700575] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "port-6e7d0c6b-def8-4a0d-b86f-bde53bb3c21e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.700899] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "port-6e7d0c6b-def8-4a0d-b86f-bde53bb3c21e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.701061] env[69232]: DEBUG networking_nsxv3.api.rpc [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6e7d0c6b-def8-4a0d-b86f-bde53bb3c21e',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.743296] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.743446] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.743516] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.743722] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.743835] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.744096] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.744251] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.744342] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.744578] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.744679] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.744811] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7ee2b034-ee73-4fda-89fe-97d3d457cb9f already deleted. [ 1142.744917] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ee2b034-ee73-4fda-89fe-97d3d457cb9f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.196070] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('714a2506-914c-4860-b68b-819348f723d0',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.203342] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.203574] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.203706] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.203996] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.204205] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.204374] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Segment Port 6e7d0c6b-def8-4a0d-b86f-bde53bb3c21e not found, creating... [ 1143.204734] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.204909] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.205077] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.205320] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.205468] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.205764] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.205929] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.206072] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.206300] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.206445] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.206590] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Resource: SegmentPort with ID: 6e7d0c6b-def8-4a0d-b86f-bde53bb3c21e is going to be created. [ 1143.228684] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.228684] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.228819] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.229113] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.229364] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.229594] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "port-6e7d0c6b-def8-4a0d-b86f-bde53bb3c21e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.697672] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('714a2506-914c-4860-b68b-819348f723d0',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.930745] env[69232]: INFO networking_nsxv3.common.synchronization [req-eea8ea7d-823e-4ab6-9d8e-3c6d2db10b62 req-8ef29e31-dafd-4a6e-9835-297dff3e409a service nova] Enqueued Resource ID: 7ee2b034-ee73-4fda-89fe-97d3d457cb9f with Priority: HIGHEST for action security_group_rules [ 1143.930885] env[69232]: INFO networking_nsxv3.common.synchronization [req-eea8ea7d-823e-4ab6-9d8e-3c6d2db10b62 req-8ef29e31-dafd-4a6e-9835-297dff3e409a service nova] Enqueued Resource ID: 7ee2b034-ee73-4fda-89fe-97d3d457cb9f with Priority: HIGHEST for action security_group_members [ 1143.931049] env[69232]: INFO networking_nsxv3.common.synchronization [req-eea8ea7d-823e-4ab6-9d8e-3c6d2db10b62 req-8ef29e31-dafd-4a6e-9835-297dff3e409a service nova] Enqueued Resource ID: 6e7d0c6b-def8-4a0d-b86f-bde53bb3c21e with Priority: HIGHEST for action port [ 1143.931593] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ee2b034-ee73-4fda-89fe-97d3d457cb9f with Priority: HIGHEST for action security_group_rules [ 1143.931739] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ee2b034-ee73-4fda-89fe-97d3d457cb9f with Priority: HIGHEST for action security_group_members [ 1143.931851] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e7d0c6b-def8-4a0d-b86f-bde53bb3c21e with Priority: HIGHEST for action port [ 1143.932209] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7ee2b034-ee73-4fda-89fe-97d3d457cb9f taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.932399] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7ee2b034-ee73-4fda-89fe-97d3d457cb9f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.932447] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7ee2b034-ee73-4fda-89fe-97d3d457cb9f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.932652] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7ee2b034-ee73-4fda-89fe-97d3d457cb9f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.932740] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7ee2b034-ee73-4fda-89fe-97d3d457cb9f',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.933622] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ee2b034-ee73-4fda-89fe-97d3d457cb9f taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.935031] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ee2b034-ee73-4fda-89fe-97d3d457cb9f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.935031] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ee2b034-ee73-4fda-89fe-97d3d457cb9f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.935031] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ee2b034-ee73-4fda-89fe-97d3d457cb9f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.935031] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.935031] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.935031] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.935342] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.935342] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.935342] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7ee2b034-ee73-4fda-89fe-97d3d457cb9f',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.936915] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-6e7d0c6b-def8-4a0d-b86f-bde53bb3c21e taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.937430] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6e7d0c6b-def8-4a0d-b86f-bde53bb3c21e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.937506] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6e7d0c6b-def8-4a0d-b86f-bde53bb3c21e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.937683] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6e7d0c6b-def8-4a0d-b86f-bde53bb3c21e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.937762] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6e7d0c6b-def8-4a0d-b86f-bde53bb3c21e',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.130547] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 83d1cdee-a934-490e-9869-707c6882be9d in Status: SUCCESS [ 1144.130805] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-83d1cdee-a934-490e-9869-707c6882be9d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.130943] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-83d1cdee-a934-490e-9869-707c6882be9d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.131194] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-83d1cdee-a934-490e-9869-707c6882be9d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.131486] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.131668] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.131794] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.132073] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.132217] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.132369] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-83d1cdee-a934-490e-9869-707c6882be9d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.132528] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('83d1cdee-a934-490e-9869-707c6882be9d',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.200548] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.200971] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.200971] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.200971] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.201090] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.201192] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 714a2506-914c-4860-b68b-819348f723d0 is going to be updated. [ 1144.234768] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.235057] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.235057] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.235301] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.235469] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.245886] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 714a2506-914c-4860-b68b-819348f723d0 in Status: IN_PROGRESS for 2s [ 1144.440908] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ee2b034-ee73-4fda-89fe-97d3d457cb9f taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.440908] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ee2b034-ee73-4fda-89fe-97d3d457cb9f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.440908] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7ee2b034-ee73-4fda-89fe-97d3d457cb9f',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.445237] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6e7d0c6b-def8-4a0d-b86f-bde53bb3c21e with status ACTIVE [ 1144.446244] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.446244] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.446244] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.446244] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.446524] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.446557] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.447966] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.447966] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.447966] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.447966] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.447966] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.448965] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.448965] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.448965] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.449133] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.449133] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6e7d0c6b-def8-4a0d-b86f-bde53bb3c21e is going to be updated. [ 1144.474100] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.474265] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.474403] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.474549] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.474681] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.476448] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6e7d0c6b-def8-4a0d-b86f-bde53bb3c21e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.634725] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-83d1cdee-a934-490e-9869-707c6882be9d taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.634935] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-83d1cdee-a934-490e-9869-707c6882be9d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.635047] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-83d1cdee-a934-490e-9869-707c6882be9d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.635326] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-83d1cdee-a934-490e-9869-707c6882be9d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.635540] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.635679] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.635752] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.636418] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.636547] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.636643] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-83d1cdee-a934-490e-9869-707c6882be9d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.636810] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-83d1cdee-a934-490e-9869-707c6882be9d taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.636934] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-83d1cdee-a934-490e-9869-707c6882be9d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.637405] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-83d1cdee-a934-490e-9869-707c6882be9d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.637626] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-83d1cdee-a934-490e-9869-707c6882be9d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.637819] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.637929] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.637992] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.638355] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.638442] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.638532] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-83d1cdee-a934-490e-9869-707c6882be9d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.638647] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('83d1cdee-a934-490e-9869-707c6882be9d',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.695107] env[69232]: INFO networking_nsxv3.common.synchronization [req-6be7222c-e55d-4295-a951-ac9a11bff243 req-9ce0cebc-3d34-4389-b8c4-1a4e5a118f50 tempest-ServersTestJSON-524901877 tempest-ServersTestJSON-524901877-project-member] Enqueued Resource ID: bdcc7a21-dd0d-4296-ac34-a880ea6123e7 with Priority: HIGHEST for action security_group_members [ 1144.695107] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdcc7a21-dd0d-4296-ac34-a880ea6123e7 with Priority: HIGHEST for action security_group_members [ 1144.695107] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.695107] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.695107] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.695107] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.695107] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.695107] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.695107] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.695107] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.695107] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.695107] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bdcc7a21-dd0d-4296-ac34-a880ea6123e7',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.945823] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7ee2b034-ee73-4fda-89fe-97d3d457cb9f',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.104483] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock network-738 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.106089] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "network-738" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.106089] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "network-738" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.106089] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "network-738" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.106089] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.106089] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.106313] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.106435] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.106673] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.107099] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1145.107267] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] NeedRegenerationException {{(pid=69232) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1145.107434] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] no value, waiting for create lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1145.107551] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] value creation lock acquired {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1145.107695] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1145.107835] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Calling creation function for not-yet-present value {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1145.108058] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1145.129372] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1145.129713] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69232) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1145.129984] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Released creation lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1145.130312] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "network-738" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.130835] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock port-d65b9821-10b9-4d24-b727-13055fee117a taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.131301] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "port-d65b9821-10b9-4d24-b727-13055fee117a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.131588] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "port-d65b9821-10b9-4d24-b727-13055fee117a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.132078] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "port-d65b9821-10b9-4d24-b727-13055fee117a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.132343] env[69232]: DEBUG networking_nsxv3.api.rpc [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d65b9821-10b9-4d24-b727-13055fee117a',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.141593] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 83d1cdee-a934-490e-9869-707c6882be9d: rpc.has_security_group_logging(os_id): False [ 1145.164645] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.164899] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.164899] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.165104] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.192031] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.192309] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.192485] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.192485] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.192689] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.192763] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.192974] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.193141] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.193141] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.193305] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.193419] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.193636] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.193773] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.193854] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.193924] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.193998] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.194110] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 83d1cdee-a934-490e-9869-707c6882be9d is going to be updated. [ 1145.195357] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bdcc7a21-dd0d-4296-ac34-a880ea6123e7',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.265078] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.265505] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.265505] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.265723] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.265890] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.281243] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 83d1cdee-a934-490e-9869-707c6882be9d in Status: IN_PROGRESS for 2s [ 1145.449850] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.450063] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.450120] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.450330] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.450425] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.450550] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7ee2b034-ee73-4fda-89fe-97d3d457cb9f is going to be created. [ 1145.481667] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.481914] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.481995] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.482403] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.482567] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.493460] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7ee2b034-ee73-4fda-89fe-97d3d457cb9f in Status: UNINITIALIZED for 2s [ 1145.635309] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.636190] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.636190] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.636350] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.636394] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.636639] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Segment Port d65b9821-10b9-4d24-b727-13055fee117a not found, creating... [ 1145.637032] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.637211] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.637365] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.637695] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.637980] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.638398] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.638664] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.638867] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.639136] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.639290] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.639445] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Resource: SegmentPort with ID: d65b9821-10b9-4d24-b727-13055fee117a is going to be created. [ 1145.668847] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.669187] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.669397] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.669687] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.669980] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.670329] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "port-d65b9821-10b9-4d24-b727-13055fee117a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.697855] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bdcc7a21-dd0d-4296-ac34-a880ea6123e7',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.200760] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.201033] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.201167] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.201519] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.201677] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.201798] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bdcc7a21-dd0d-4296-ac34-a880ea6123e7 is going to be updated. [ 1146.249976] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.250841] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.250944] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.251261] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.251467] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.258764] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 714a2506-914c-4860-b68b-819348f723d0 in Status: SUCCESS [ 1146.258983] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-714a2506-914c-4860-b68b-819348f723d0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.259169] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-714a2506-914c-4860-b68b-819348f723d0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.259390] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-714a2506-914c-4860-b68b-819348f723d0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.259683] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.259893] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.260009] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.260425] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.260679] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.260970] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('714a2506-914c-4860-b68b-819348f723d0',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.264925] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bdcc7a21-dd0d-4296-ac34-a880ea6123e7 in Status: IN_PROGRESS for 2s [ 1146.569873] env[69232]: INFO networking_nsxv3.common.synchronization [req-6be7222c-e55d-4295-a951-ac9a11bff243 req-1c7c5292-e186-47cb-8c61-3b8cd5ac24dd service nova] Enqueued Resource ID: bdcc7a21-dd0d-4296-ac34-a880ea6123e7 with Priority: HIGHEST for action security_group_rules [ 1146.569873] env[69232]: INFO networking_nsxv3.common.synchronization [req-6be7222c-e55d-4295-a951-ac9a11bff243 req-1c7c5292-e186-47cb-8c61-3b8cd5ac24dd service nova] Enqueued Resource ID: bdcc7a21-dd0d-4296-ac34-a880ea6123e7 with Priority: HIGHEST for action security_group_members [ 1146.569873] env[69232]: INFO networking_nsxv3.common.synchronization [req-6be7222c-e55d-4295-a951-ac9a11bff243 req-1c7c5292-e186-47cb-8c61-3b8cd5ac24dd service nova] Enqueued Resource ID: d65b9821-10b9-4d24-b727-13055fee117a with Priority: HIGHEST for action port [ 1146.569873] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdcc7a21-dd0d-4296-ac34-a880ea6123e7 with Priority: HIGHEST for action security_group_rules [ 1146.570452] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdcc7a21-dd0d-4296-ac34-a880ea6123e7 with Priority: HIGHEST for action security_group_members [ 1146.570452] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d65b9821-10b9-4d24-b727-13055fee117a with Priority: HIGHEST for action port [ 1146.570452] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bdcc7a21-dd0d-4296-ac34-a880ea6123e7 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.570593] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.570593] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.570764] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.570852] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bdcc7a21-dd0d-4296-ac34-a880ea6123e7',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.571809] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.571901] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.572200] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-d65b9821-10b9-4d24-b727-13055fee117a taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.572286] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d65b9821-10b9-4d24-b727-13055fee117a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.572367] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d65b9821-10b9-4d24-b727-13055fee117a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.572555] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d65b9821-10b9-4d24-b727-13055fee117a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.572646] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d65b9821-10b9-4d24-b727-13055fee117a',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.764349] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('714a2506-914c-4860-b68b-819348f723d0',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.075774] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.076033] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.076109] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d65b9821-10b9-4d24-b727-13055fee117a with status ACTIVE [ 1147.076525] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.076525] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.076525] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.076831] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.076878] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.077129] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.077274] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.077344] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.077707] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.077707] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.077825] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.077922] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.077985] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.078183] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.078294] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.078392] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d65b9821-10b9-4d24-b727-13055fee117a is going to be updated. [ 1147.104022] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.105777] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.105777] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.105777] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.105777] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.105777] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d65b9821-10b9-4d24-b727-13055fee117a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.267680] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('714a2506-914c-4860-b68b-819348f723d0',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.301039] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 83d1cdee-a934-490e-9869-707c6882be9d in Status: SUCCESS [ 1147.301309] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-83d1cdee-a934-490e-9869-707c6882be9d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.515148] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7ee2b034-ee73-4fda-89fe-97d3d457cb9f in Status: SUCCESS [ 1147.515514] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ee2b034-ee73-4fda-89fe-97d3d457cb9f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.515773] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ee2b034-ee73-4fda-89fe-97d3d457cb9f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.516134] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ee2b034-ee73-4fda-89fe-97d3d457cb9f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.516382] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.516578] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.516657] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.517064] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.517173] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.517275] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ee2b034-ee73-4fda-89fe-97d3d457cb9f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.517373] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7ee2b034-ee73-4fda-89fe-97d3d457cb9f',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.771298] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.771858] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.771858] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.771858] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.771858] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.772153] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 714a2506-914c-4860-b68b-819348f723d0 is going to be updated. [ 1147.806208] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.806421] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.806524] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.806746] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.806890] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.817725] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 714a2506-914c-4860-b68b-819348f723d0 in Status: IN_PROGRESS for 2s [ 1148.020093] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7ee2b034-ee73-4fda-89fe-97d3d457cb9f',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.277201] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bdcc7a21-dd0d-4296-ac34-a880ea6123e7 in Status: SUCCESS [ 1148.277612] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.277805] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.278089] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.278410] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.278603] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.278754] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.280040] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.280123] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.280228] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bdcc7a21-dd0d-4296-ac34-a880ea6123e7',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.523420] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7ee2b034-ee73-4fda-89fe-97d3d457cb9f: rpc.has_security_group_logging(os_id): False [ 1148.543139] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.543296] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.543357] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.543701] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.543838] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.544440] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.544440] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.544440] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.544630] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.545050] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.545050] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7ee2b034-ee73-4fda-89fe-97d3d457cb9f is going to be created. [ 1148.617381] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.617651] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.617782] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.618124] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.618416] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.630978] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7ee2b034-ee73-4fda-89fe-97d3d457cb9f in Status: IN_PROGRESS for 2s [ 1148.784891] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bdcc7a21-dd0d-4296-ac34-a880ea6123e7',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.080154] env[69232]: INFO networking_nsxv3.common.synchronization [req-a9ffe908-cc10-45cd-ab78-9a37cf9f358a req-b609e501-b78a-45ee-98d9-8b915a692a5e tempest-ListServersNegativeTestJSON-1485357193 tempest-ListServersNegativeTestJSON-1485357193-project-member] Enqueued Resource ID: 714a2506-914c-4860-b68b-819348f723d0 with Priority: HIGHEST for action security_group_members [ 1149.080715] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 714a2506-914c-4860-b68b-819348f723d0 with Priority: HIGHEST for action security_group_members [ 1149.081039] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-714a2506-914c-4860-b68b-819348f723d0 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.081150] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-714a2506-914c-4860-b68b-819348f723d0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.285931] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bdcc7a21-dd0d-4296-ac34-a880ea6123e7',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.788527] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.788949] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.788949] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.788949] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.789118] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.789169] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bdcc7a21-dd0d-4296-ac34-a880ea6123e7 is going to be updated. [ 1149.827913] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.828063] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.829021] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.829021] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.829021] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.830132] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 714a2506-914c-4860-b68b-819348f723d0 in Status: SUCCESS [ 1149.830355] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-714a2506-914c-4860-b68b-819348f723d0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.830834] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-714a2506-914c-4860-b68b-819348f723d0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.831148] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-714a2506-914c-4860-b68b-819348f723d0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.831364] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.831557] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.831557] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.831701] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.831777] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.831856] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-714a2506-914c-4860-b68b-819348f723d0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.832052] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-714a2506-914c-4860-b68b-819348f723d0 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.832141] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-714a2506-914c-4860-b68b-819348f723d0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.832200] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-714a2506-914c-4860-b68b-819348f723d0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.832512] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-714a2506-914c-4860-b68b-819348f723d0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.832512] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.832664] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.832777] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.832927] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.833020] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.833098] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-714a2506-914c-4860-b68b-819348f723d0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.833184] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('714a2506-914c-4860-b68b-819348f723d0',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.834010] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-714a2506-914c-4860-b68b-819348f723d0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.834222] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-714a2506-914c-4860-b68b-819348f723d0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.834381] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.834487] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.834544] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.837051] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.837051] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.837051] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('714a2506-914c-4860-b68b-819348f723d0',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.865630] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bdcc7a21-dd0d-4296-ac34-a880ea6123e7 in Status: IN_PROGRESS for 2s [ 1150.340575] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 714a2506-914c-4860-b68b-819348f723d0: rpc.has_security_group_logging(os_id): False [ 1150.341883] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('714a2506-914c-4860-b68b-819348f723d0',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.363022] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.363022] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.363022] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.363022] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.363022] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.363022] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.363022] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.363022] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.363022] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.363022] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.363022] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.363022] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.363022] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.363022] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.363022] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.364256] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.364556] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.364722] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.365027] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.365255] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.365477] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 714a2506-914c-4860-b68b-819348f723d0 is going to be created. [ 1150.434446] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.434446] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.434446] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.434446] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.434446] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.446652] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 714a2506-914c-4860-b68b-819348f723d0 in Status: IN_PROGRESS for 2s [ 1150.659397] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7ee2b034-ee73-4fda-89fe-97d3d457cb9f in Status: SUCCESS [ 1150.659571] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7ee2b034-ee73-4fda-89fe-97d3d457cb9f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.845431] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('714a2506-914c-4860-b68b-819348f723d0',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.347711] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.347906] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.347982] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.348286] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.348393] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.348499] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 714a2506-914c-4860-b68b-819348f723d0 is going to be updated. [ 1151.383776] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.384037] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.384037] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.384265] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.384426] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.394979] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 714a2506-914c-4860-b68b-819348f723d0 in Status: IN_PROGRESS for 2s [ 1151.877398] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bdcc7a21-dd0d-4296-ac34-a880ea6123e7 in Status: SUCCESS [ 1151.877741] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.877858] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.878093] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.878293] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.878432] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.878496] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.878635] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.878723] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.878794] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.878886] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bdcc7a21-dd0d-4296-ac34-a880ea6123e7',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.962525] env[69232]: INFO networking_nsxv3.common.synchronization [req-2d4b625f-f0df-4500-a682-d0775426ede6 req-32fd375d-325c-4708-b674-5fac616d88f3 tempest-AttachInterfacesTestJSON-1442903876 tempest-AttachInterfacesTestJSON-1442903876-project-member] Enqueued Resource ID: 0909b11c-c2d6-4d46-9a46-74243fd12a97 with Priority: HIGHEST for action security_group_members [ 1151.964283] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0909b11c-c2d6-4d46-9a46-74243fd12a97 with Priority: HIGHEST for action security_group_members [ 1151.965498] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-0909b11c-c2d6-4d46-9a46-74243fd12a97 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.965498] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0909b11c-c2d6-4d46-9a46-74243fd12a97" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.965498] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0909b11c-c2d6-4d46-9a46-74243fd12a97" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.965498] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0909b11c-c2d6-4d46-9a46-74243fd12a97" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.965725] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.965725] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.965811] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.966037] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.966147] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.966238] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0909b11c-c2d6-4d46-9a46-74243fd12a97',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.381456] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.381668] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.381732] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.382262] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.382369] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.382438] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.382438] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.382614] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.382702] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.382791] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.382941] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.383046] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.383202] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.383455] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.383622] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.383719] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.383781] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.383926] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.384009] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.384320] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.385108] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bdcc7a21-dd0d-4296-ac34-a880ea6123e7',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.461938] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 714a2506-914c-4860-b68b-819348f723d0 in Status: SUCCESS [ 1152.462336] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-714a2506-914c-4860-b68b-819348f723d0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.462540] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-714a2506-914c-4860-b68b-819348f723d0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.462774] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-714a2506-914c-4860-b68b-819348f723d0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.462865] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('714a2506-914c-4860-b68b-819348f723d0',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.469459] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0909b11c-c2d6-4d46-9a46-74243fd12a97',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.890559] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bdcc7a21-dd0d-4296-ac34-a880ea6123e7: rpc.has_security_group_logging(os_id): False [ 1152.910475] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.910633] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.910708] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.910929] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.934406] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.934806] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.934806] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.934934] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.935065] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.935151] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.935395] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.935524] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.935588] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.935786] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.935894] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.936018] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.936126] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.936180] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.936323] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.936399] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.936493] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bdcc7a21-dd0d-4296-ac34-a880ea6123e7 is going to be updated. [ 1152.965691] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-714a2506-914c-4860-b68b-819348f723d0 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.965691] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-714a2506-914c-4860-b68b-819348f723d0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.971108] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0909b11c-c2d6-4d46-9a46-74243fd12a97',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.004420] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.004607] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.004661] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.004885] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.005062] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.023291] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bdcc7a21-dd0d-4296-ac34-a880ea6123e7 in Status: IN_PROGRESS for 2s [ 1153.404994] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 714a2506-914c-4860-b68b-819348f723d0 in Status: SUCCESS [ 1153.405286] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-714a2506-914c-4860-b68b-819348f723d0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.405463] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-714a2506-914c-4860-b68b-819348f723d0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.405695] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-714a2506-914c-4860-b68b-819348f723d0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.405879] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.405991] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.406071] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.406227] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.406308] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.406390] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-714a2506-914c-4860-b68b-819348f723d0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.406513] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('714a2506-914c-4860-b68b-819348f723d0',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.473606] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.473816] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.473816] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.474052] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.474145] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.474300] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0909b11c-c2d6-4d46-9a46-74243fd12a97 is going to be updated. [ 1153.503836] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.504080] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.504080] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.504341] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.504511] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.513279] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0909b11c-c2d6-4d46-9a46-74243fd12a97 in Status: IN_PROGRESS for 2s [ 1153.908822] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-714a2506-914c-4860-b68b-819348f723d0 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.909333] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-714a2506-914c-4860-b68b-819348f723d0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.909333] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-714a2506-914c-4860-b68b-819348f723d0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.909491] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-714a2506-914c-4860-b68b-819348f723d0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.909702] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.909816] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.909880] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.910081] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.910179] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.910275] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-714a2506-914c-4860-b68b-819348f723d0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.910435] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-714a2506-914c-4860-b68b-819348f723d0 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.910536] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-714a2506-914c-4860-b68b-819348f723d0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.910651] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-714a2506-914c-4860-b68b-819348f723d0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.910750] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-714a2506-914c-4860-b68b-819348f723d0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.911798] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.911798] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.911798] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.911798] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.911798] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.911798] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-714a2506-914c-4860-b68b-819348f723d0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.911798] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('714a2506-914c-4860-b68b-819348f723d0',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.416696] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 714a2506-914c-4860-b68b-819348f723d0: rpc.has_security_group_logging(os_id): False [ 1154.439023] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.439023] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.439023] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.439023] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.439023] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.439023] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.439023] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.439023] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.439023] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.439023] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.439023] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.439023] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.439023] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.439023] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.439023] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.439723] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.439723] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.439723] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.440024] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.440207] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.440393] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 714a2506-914c-4860-b68b-819348f723d0 is going to be updated. [ 1154.519589] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.519589] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.519589] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.519589] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.520043] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.538731] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 714a2506-914c-4860-b68b-819348f723d0 in Status: IN_PROGRESS for 2s [ 1155.040149] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bdcc7a21-dd0d-4296-ac34-a880ea6123e7 in Status: SUCCESS [ 1155.040546] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.523571] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0909b11c-c2d6-4d46-9a46-74243fd12a97 in Status: SUCCESS [ 1155.523787] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0909b11c-c2d6-4d46-9a46-74243fd12a97" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.369434] env[69232]: INFO networking_nsxv3.common.synchronization [req-5c99ac56-2c0f-4827-bcf9-b730aa600ef5 req-93f1de5c-4444-4877-a6f5-e3fb1f6c19fc tempest-ServerActionsTestOtherB-650813181 tempest-ServerActionsTestOtherB-650813181-project-member] Enqueued Resource ID: 934b2684-b99c-4846-87df-66cbae10f2fc with Priority: HIGHEST for action security_group_members [ 1156.369434] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 934b2684-b99c-4846-87df-66cbae10f2fc with Priority: HIGHEST for action security_group_members [ 1156.369734] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-934b2684-b99c-4846-87df-66cbae10f2fc taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.369734] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-934b2684-b99c-4846-87df-66cbae10f2fc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.369734] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-934b2684-b99c-4846-87df-66cbae10f2fc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.369878] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-934b2684-b99c-4846-87df-66cbae10f2fc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.370011] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.370137] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.370181] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.370331] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.370453] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.370508] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('934b2684-b99c-4846-87df-66cbae10f2fc',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.558062] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 714a2506-914c-4860-b68b-819348f723d0 in Status: SUCCESS [ 1156.558552] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-714a2506-914c-4860-b68b-819348f723d0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.558552] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-714a2506-914c-4860-b68b-819348f723d0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.558887] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-714a2506-914c-4860-b68b-819348f723d0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.558968] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('714a2506-914c-4860-b68b-819348f723d0',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.686257] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock network-424 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.686561] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "network-424" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.686783] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "network-424" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.687533] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "network-424" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.687850] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.688041] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.688238] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.688419] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.688600] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.688849] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1156.688967] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] NeedRegenerationException {{(pid=69232) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1156.689097] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] no value, waiting for create lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1156.689211] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] value creation lock acquired {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1156.689327] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1156.689440] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Calling creation function for not-yet-present value {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1156.689582] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1156.709727] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1156.709910] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69232) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1156.712863] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Released creation lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1156.712863] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "network-424" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.712863] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock port-7af1152f-9b64-46a2-91d0-99b34ba7bd05 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.712863] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "port-7af1152f-9b64-46a2-91d0-99b34ba7bd05" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.712863] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "port-7af1152f-9b64-46a2-91d0-99b34ba7bd05" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.712863] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "port-7af1152f-9b64-46a2-91d0-99b34ba7bd05" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.712863] env[69232]: DEBUG networking_nsxv3.api.rpc [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7af1152f-9b64-46a2-91d0-99b34ba7bd05',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.874185] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.874436] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.874500] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.874714] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.874804] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.875011] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.875115] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.875179] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.875376] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.875450] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.875538] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 934b2684-b99c-4846-87df-66cbae10f2fc is going to be updated. [ 1156.902276] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.902475] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.902475] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.902628] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.902773] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.913868] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 934b2684-b99c-4846-87df-66cbae10f2fc in Status: IN_PROGRESS for 2s [ 1157.061377] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-714a2506-914c-4860-b68b-819348f723d0 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.061540] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-714a2506-914c-4860-b68b-819348f723d0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.061696] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-714a2506-914c-4860-b68b-819348f723d0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.061824] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-714a2506-914c-4860-b68b-819348f723d0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.062016] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.062130] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.062191] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.062601] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.062908] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.062908] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-714a2506-914c-4860-b68b-819348f723d0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.062982] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('714a2506-914c-4860-b68b-819348f723d0',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1157.214532] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.214848] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.214988] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.215357] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.216079] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.216079] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Segment Port 7af1152f-9b64-46a2-91d0-99b34ba7bd05 not found, creating... [ 1157.216079] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.216328] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.216328] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.216632] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.216796] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.217283] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.217558] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.217737] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.218029] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.218573] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.218573] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Resource: SegmentPort with ID: 7af1152f-9b64-46a2-91d0-99b34ba7bd05 is going to be created. [ 1157.240382] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.240801] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.241256] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.241596] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.241904] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.242482] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "port-7af1152f-9b64-46a2-91d0-99b34ba7bd05" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.566398] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-714a2506-914c-4860-b68b-819348f723d0 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.566808] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-714a2506-914c-4860-b68b-819348f723d0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.566808] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-714a2506-914c-4860-b68b-819348f723d0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.566948] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-714a2506-914c-4860-b68b-819348f723d0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.567130] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.567267] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.567330] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.567445] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.567587] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.567728] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-714a2506-914c-4860-b68b-819348f723d0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.567780] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-714a2506-914c-4860-b68b-819348f723d0 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.568495] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-714a2506-914c-4860-b68b-819348f723d0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.568495] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-714a2506-914c-4860-b68b-819348f723d0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.568495] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-714a2506-914c-4860-b68b-819348f723d0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.568495] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.568495] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.568495] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.568495] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.568975] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.568975] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-714a2506-914c-4860-b68b-819348f723d0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.568975] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('714a2506-914c-4860-b68b-819348f723d0',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1157.955255] env[69232]: INFO networking_nsxv3.common.synchronization [req-5c99ac56-2c0f-4827-bcf9-b730aa600ef5 req-3894a40e-26b1-4097-aa16-fb1431162307 service nova] Enqueued Resource ID: 934b2684-b99c-4846-87df-66cbae10f2fc with Priority: HIGHEST for action security_group_rules [ 1157.955255] env[69232]: INFO networking_nsxv3.common.synchronization [req-5c99ac56-2c0f-4827-bcf9-b730aa600ef5 req-3894a40e-26b1-4097-aa16-fb1431162307 service nova] Enqueued Resource ID: 934b2684-b99c-4846-87df-66cbae10f2fc with Priority: HIGHEST for action security_group_members [ 1157.955255] env[69232]: INFO networking_nsxv3.common.synchronization [req-5c99ac56-2c0f-4827-bcf9-b730aa600ef5 req-3894a40e-26b1-4097-aa16-fb1431162307 service nova] Enqueued Resource ID: 7af1152f-9b64-46a2-91d0-99b34ba7bd05 with Priority: HIGHEST for action port [ 1157.955619] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 934b2684-b99c-4846-87df-66cbae10f2fc with Priority: HIGHEST for action security_group_rules [ 1157.955725] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 934b2684-b99c-4846-87df-66cbae10f2fc with Priority: HIGHEST for action security_group_members [ 1157.955870] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7af1152f-9b64-46a2-91d0-99b34ba7bd05 with Priority: HIGHEST for action port [ 1157.958204] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-934b2684-b99c-4846-87df-66cbae10f2fc taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.958417] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-934b2684-b99c-4846-87df-66cbae10f2fc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.958451] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-934b2684-b99c-4846-87df-66cbae10f2fc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.958664] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-934b2684-b99c-4846-87df-66cbae10f2fc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.958743] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('934b2684-b99c-4846-87df-66cbae10f2fc',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1157.960146] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-934b2684-b99c-4846-87df-66cbae10f2fc taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.960257] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-934b2684-b99c-4846-87df-66cbae10f2fc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.960660] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-7af1152f-9b64-46a2-91d0-99b34ba7bd05 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.960660] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7af1152f-9b64-46a2-91d0-99b34ba7bd05" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.960660] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7af1152f-9b64-46a2-91d0-99b34ba7bd05" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.960824] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7af1152f-9b64-46a2-91d0-99b34ba7bd05" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.961686] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7af1152f-9b64-46a2-91d0-99b34ba7bd05',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.074871] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 714a2506-914c-4860-b68b-819348f723d0: rpc.has_security_group_logging(os_id): False [ 1158.097086] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.097086] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.097086] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.097086] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.097086] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.097086] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.097495] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.097495] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.097495] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.097607] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.097809] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.097946] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.098026] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.098232] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.098323] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.098568] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.098707] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.098806] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.098984] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.099101] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.099214] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 714a2506-914c-4860-b68b-819348f723d0 is going to be updated. [ 1158.164715] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.164921] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.164921] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.165324] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.165563] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.181659] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 714a2506-914c-4860-b68b-819348f723d0 in Status: IN_PROGRESS for 2s [ 1158.463164] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-934b2684-b99c-4846-87df-66cbae10f2fc taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.463313] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-934b2684-b99c-4846-87df-66cbae10f2fc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.463450] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7af1152f-9b64-46a2-91d0-99b34ba7bd05 with status ACTIVE [ 1158.463616] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.463746] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.463792] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.464021] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.464136] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.464364] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.464520] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.464582] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.464716] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.464900] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.465014] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.465101] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.465154] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.465355] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.465444] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.465506] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7af1152f-9b64-46a2-91d0-99b34ba7bd05 is going to be updated. [ 1158.485979] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.485979] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.486275] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.486275] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.486387] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.486549] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7af1152f-9b64-46a2-91d0-99b34ba7bd05" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.904274] env[69232]: INFO networking_nsxv3.common.synchronization [req-1a9f6002-9792-43bb-817d-72d724eec344 req-62872711-c68e-4284-bcfe-df5512def04b tempest-ServersTestJSON-524901877 tempest-ServersTestJSON-524901877-project-member] Enqueued Resource ID: bdcc7a21-dd0d-4296-ac34-a880ea6123e7 with Priority: HIGHEST for action security_group_members [ 1158.905710] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdcc7a21-dd0d-4296-ac34-a880ea6123e7 with Priority: HIGHEST for action security_group_members [ 1158.905710] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.905956] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.905956] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.906097] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.907028] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.907028] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.907028] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.907028] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.907028] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.907028] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bdcc7a21-dd0d-4296-ac34-a880ea6123e7',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.926354] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 934b2684-b99c-4846-87df-66cbae10f2fc in Status: SUCCESS [ 1158.926523] env[69232]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 934b2684-b99c-4846-87df-66cbae10f2fc deletion is rescheduled due to dependency. [ 1158.926653] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-934b2684-b99c-4846-87df-66cbae10f2fc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.927662] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-934b2684-b99c-4846-87df-66cbae10f2fc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.927662] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-934b2684-b99c-4846-87df-66cbae10f2fc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.927662] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.927662] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.927662] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.928046] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.928046] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.928046] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('934b2684-b99c-4846-87df-66cbae10f2fc',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.409164] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bdcc7a21-dd0d-4296-ac34-a880ea6123e7',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.430980] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('934b2684-b99c-4846-87df-66cbae10f2fc',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.866408] env[69232]: INFO networking_nsxv3.common.synchronization [req-72b62f33-2579-4e88-8ce3-88a7a75579a4 req-6bc5fa18-e752-4b8a-aa64-a8904bfed671 tempest-DeleteServersTestJSON-830271628 tempest-DeleteServersTestJSON-830271628-project-member] Enqueued Resource ID: 9f5186e6-2d35-4ccf-a8b4-749a0a872128 with Priority: HIGHEST for action security_group_members [ 1159.867053] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f5186e6-2d35-4ccf-a8b4-749a0a872128 with Priority: HIGHEST for action security_group_members [ 1159.867375] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f5186e6-2d35-4ccf-a8b4-749a0a872128 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.867502] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.867566] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.867775] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.871897] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.872086] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.872161] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.872354] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.872446] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.872550] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9f5186e6-2d35-4ccf-a8b4-749a0a872128',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.911339] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bdcc7a21-dd0d-4296-ac34-a880ea6123e7',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.935134] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('934b2684-b99c-4846-87df-66cbae10f2fc',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1160.031315] env[69232]: INFO networking_nsxv3.common.synchronization [req-e1450799-db58-41eb-8a3a-78b9f94014d4 req-39b1f3d2-f670-413f-9817-508719877192 tempest-ListServersNegativeTestJSON-1485357193 tempest-ListServersNegativeTestJSON-1485357193-project-member] Enqueued Resource ID: 714a2506-914c-4860-b68b-819348f723d0 with Priority: HIGHEST for action security_group_members [ 1160.031874] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 714a2506-914c-4860-b68b-819348f723d0 with Priority: HIGHEST for action security_group_members [ 1160.032712] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-714a2506-914c-4860-b68b-819348f723d0 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.033368] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-714a2506-914c-4860-b68b-819348f723d0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.033368] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-714a2506-914c-4860-b68b-819348f723d0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.033368] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-714a2506-914c-4860-b68b-819348f723d0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.033368] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.033368] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.033599] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.033599] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.033690] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.033746] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('714a2506-914c-4860-b68b-819348f723d0',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1160.198155] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 714a2506-914c-4860-b68b-819348f723d0 in Status: SUCCESS [ 1160.198499] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-714a2506-914c-4860-b68b-819348f723d0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.231474] env[69232]: INFO networking_nsxv3.common.synchronization [req-277a9fb6-7a18-4eaa-ac95-655af868f506 req-94622516-8a2e-481d-9644-917f4177aef5 tempest-ListServersNegativeTestJSON-1485357193 tempest-ListServersNegativeTestJSON-1485357193-project-member] Enqueued Resource ID: 714a2506-914c-4860-b68b-819348f723d0 with Priority: HIGHEST for action security_group_members [ 1160.231474] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 714a2506-914c-4860-b68b-819348f723d0 with Priority: HIGHEST for action security_group_members [ 1160.231474] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-714a2506-914c-4860-b68b-819348f723d0 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.231474] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-714a2506-914c-4860-b68b-819348f723d0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.285377] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock network-279 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.285573] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "network-279" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.285696] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "network-279" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.285972] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "network-279" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.286249] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.286413] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.286539] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.286762] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.286918] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.287184] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1160.287270] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] NeedRegenerationException {{(pid=69232) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1160.287416] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] no value, waiting for create lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1160.287543] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] value creation lock acquired {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1160.287662] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1160.287772] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Calling creation function for not-yet-present value {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1160.287911] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1160.309990] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1160.310239] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69232) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1160.310394] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Released creation lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1160.310594] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "network-279" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.310979] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock port-9521dfeb-689f-4246-879c-511cbdf5c481 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.311245] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "port-9521dfeb-689f-4246-879c-511cbdf5c481" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.311350] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "port-9521dfeb-689f-4246-879c-511cbdf5c481" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.311822] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "port-9521dfeb-689f-4246-879c-511cbdf5c481" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.312167] env[69232]: DEBUG networking_nsxv3.api.rpc [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9521dfeb-689f-4246-879c-511cbdf5c481',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1160.376236] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.376480] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.376626] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.376838] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.376996] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.377304] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.377459] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.377553] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.377783] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.377858] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.377956] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9f5186e6-2d35-4ccf-a8b4-749a0a872128 is going to be updated. [ 1160.413411] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.413667] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.413667] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.413871] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.413970] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.414104] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bdcc7a21-dd0d-4296-ac34-a880ea6123e7 is going to be updated. [ 1160.427392] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.427634] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.427702] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.427950] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.428119] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.436058] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f5186e6-2d35-4ccf-a8b4-749a0a872128 in Status: IN_PROGRESS for 2s [ 1160.439144] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.439144] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.439144] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.439144] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.439144] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.439370] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 934b2684-b99c-4846-87df-66cbae10f2fc is going to be updated. [ 1160.450473] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.450473] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.450473] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.450473] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.450473] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.458564] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bdcc7a21-dd0d-4296-ac34-a880ea6123e7 in Status: IN_PROGRESS for 2s [ 1160.471580] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.471580] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.471580] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.471580] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.471870] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.503467] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 934b2684-b99c-4846-87df-66cbae10f2fc in Status: IN_PROGRESS for 2s [ 1160.536108] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('714a2506-914c-4860-b68b-819348f723d0',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1160.814902] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.815163] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.815317] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.815640] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.815803] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.815963] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Segment Port 9521dfeb-689f-4246-879c-511cbdf5c481 not found, creating... [ 1160.816251] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.816414] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.816534] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.816803] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.816950] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.817251] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.817408] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.817529] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.817743] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.817881] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.818028] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Resource: SegmentPort with ID: 9521dfeb-689f-4246-879c-511cbdf5c481 is going to be created. [ 1160.838048] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.838338] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.838410] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.838733] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.838912] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.839152] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "port-9521dfeb-689f-4246-879c-511cbdf5c481" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.039238] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('714a2506-914c-4860-b68b-819348f723d0',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1161.541661] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.541792] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.541792] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.542012] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.542142] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.542249] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 714a2506-914c-4860-b68b-819348f723d0 is going to be updated. [ 1161.549028] env[69232]: INFO networking_nsxv3.common.synchronization [req-72b62f33-2579-4e88-8ce3-88a7a75579a4 req-1869e081-2394-46b0-ab93-d1c86abd7316 service nova] Enqueued Resource ID: 9f5186e6-2d35-4ccf-a8b4-749a0a872128 with Priority: HIGHEST for action security_group_rules [ 1161.549159] env[69232]: INFO networking_nsxv3.common.synchronization [req-72b62f33-2579-4e88-8ce3-88a7a75579a4 req-1869e081-2394-46b0-ab93-d1c86abd7316 service nova] Enqueued Resource ID: 9f5186e6-2d35-4ccf-a8b4-749a0a872128 with Priority: HIGHEST for action security_group_members [ 1161.551130] env[69232]: INFO networking_nsxv3.common.synchronization [req-72b62f33-2579-4e88-8ce3-88a7a75579a4 req-1869e081-2394-46b0-ab93-d1c86abd7316 service nova] Enqueued Resource ID: 9521dfeb-689f-4246-879c-511cbdf5c481 with Priority: HIGHEST for action port [ 1161.551130] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f5186e6-2d35-4ccf-a8b4-749a0a872128 with Priority: HIGHEST for action security_group_rules [ 1161.551130] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f5186e6-2d35-4ccf-a8b4-749a0a872128 with Priority: HIGHEST for action security_group_members [ 1161.551130] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9521dfeb-689f-4246-879c-511cbdf5c481 with Priority: HIGHEST for action port [ 1161.551130] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9f5186e6-2d35-4ccf-a8b4-749a0a872128 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.551130] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.551130] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.551130] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.551130] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9f5186e6-2d35-4ccf-a8b4-749a0a872128',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1161.551777] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f5186e6-2d35-4ccf-a8b4-749a0a872128 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.551829] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.552448] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-9521dfeb-689f-4246-879c-511cbdf5c481 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.552448] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9521dfeb-689f-4246-879c-511cbdf5c481" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.552448] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9521dfeb-689f-4246-879c-511cbdf5c481" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.552448] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9521dfeb-689f-4246-879c-511cbdf5c481" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.552448] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9521dfeb-689f-4246-879c-511cbdf5c481',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1161.584264] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.584529] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.584529] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.584699] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.584837] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.594735] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 714a2506-914c-4860-b68b-819348f723d0 in Status: IN_PROGRESS for 2s [ 1162.054093] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f5186e6-2d35-4ccf-a8b4-749a0a872128 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.054633] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.054633] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9521dfeb-689f-4246-879c-511cbdf5c481 with status ACTIVE [ 1162.054884] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.054884] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.054992] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.055210] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.055305] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.055522] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.055636] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.055692] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.055875] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.056574] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.056574] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.056574] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.056574] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.056574] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.056574] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.056874] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9521dfeb-689f-4246-879c-511cbdf5c481 is going to be updated. [ 1162.081211] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.081478] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.081478] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.081620] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.081759] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.081920] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9521dfeb-689f-4246-879c-511cbdf5c481" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.447640] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f5186e6-2d35-4ccf-a8b4-749a0a872128 in Status: SUCCESS [ 1162.447959] env[69232]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9f5186e6-2d35-4ccf-a8b4-749a0a872128 deletion is rescheduled due to dependency. [ 1162.447959] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.448130] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.448341] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.448539] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.448705] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.448776] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.448941] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.449038] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.449137] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9f5186e6-2d35-4ccf-a8b4-749a0a872128',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.468318] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bdcc7a21-dd0d-4296-ac34-a880ea6123e7 in Status: SUCCESS [ 1162.468585] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.514793] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 934b2684-b99c-4846-87df-66cbae10f2fc in Status: SUCCESS [ 1162.515035] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-934b2684-b99c-4846-87df-66cbae10f2fc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.515230] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-934b2684-b99c-4846-87df-66cbae10f2fc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.515542] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-934b2684-b99c-4846-87df-66cbae10f2fc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.515678] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.515801] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.515878] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.516048] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.516129] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.516216] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-934b2684-b99c-4846-87df-66cbae10f2fc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.516309] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('934b2684-b99c-4846-87df-66cbae10f2fc',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.951799] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9f5186e6-2d35-4ccf-a8b4-749a0a872128',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.019931] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('934b2684-b99c-4846-87df-66cbae10f2fc',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.454103] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9f5186e6-2d35-4ccf-a8b4-749a0a872128',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.521870] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 934b2684-b99c-4846-87df-66cbae10f2fc: rpc.has_security_group_logging(os_id): False [ 1163.543482] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.543698] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.543698] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.543908] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.543986] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.544255] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.544393] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.544461] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.544630] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.544709] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.544801] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 934b2684-b99c-4846-87df-66cbae10f2fc is going to be updated. [ 1163.607952] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 714a2506-914c-4860-b68b-819348f723d0 in Status: SUCCESS [ 1163.608135] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-714a2506-914c-4860-b68b-819348f723d0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.608315] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-714a2506-914c-4860-b68b-819348f723d0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.608547] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-714a2506-914c-4860-b68b-819348f723d0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.608739] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.608855] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.608920] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.609090] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.609171] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.609266] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('714a2506-914c-4860-b68b-819348f723d0',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.644521] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.644733] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.644733] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.644959] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.645124] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.665486] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 934b2684-b99c-4846-87df-66cbae10f2fc in Status: IN_PROGRESS for 2s [ 1163.957046] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.958205] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.958205] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.958205] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.958205] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.958205] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9f5186e6-2d35-4ccf-a8b4-749a0a872128 is going to be updated. [ 1163.990052] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.990251] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.990572] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.990862] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.991083] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.003165] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f5186e6-2d35-4ccf-a8b4-749a0a872128 in Status: IN_PROGRESS for 2s [ 1164.111987] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.112196] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.112305] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.112628] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.112768] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.113082] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.113243] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.113340] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.113723] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.113723] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.113918] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 714a2506-914c-4860-b68b-819348f723d0 is going to be updated. [ 1164.127417] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock network-548 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.127856] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "network-548" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.128192] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "network-548" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.128425] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "network-548" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.128938] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.129180] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.129417] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.129820] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.130094] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.130451] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1164.130657] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] NeedRegenerationException {{(pid=69232) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1164.130858] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] no value, waiting for create lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1164.131146] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] value creation lock acquired {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1164.131273] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1164.131487] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Calling creation function for not-yet-present value {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1164.131743] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1164.161482] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1164.161790] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=69232) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1164.162055] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Released creation lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1164.162375] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "network-548" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.162848] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock port-8f56ac24-8c04-4bbd-b439-c7d0338161ae taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.163185] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "port-8f56ac24-8c04-4bbd-b439-c7d0338161ae" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.163413] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "port-8f56ac24-8c04-4bbd-b439-c7d0338161ae" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.163837] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "port-8f56ac24-8c04-4bbd-b439-c7d0338161ae" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.164192] env[69232]: DEBUG networking_nsxv3.api.rpc [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8f56ac24-8c04-4bbd-b439-c7d0338161ae',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.183915] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.184301] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.184301] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.184501] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.184574] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.195711] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 714a2506-914c-4860-b68b-819348f723d0 in Status: IN_PROGRESS for 2s [ 1164.667570] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.668073] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.668073] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.668424] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.668598] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.668931] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.669142] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.669294] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.669619] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.669850] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.670522] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.670713] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.670839] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.671091] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.671242] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.671396] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Resource: SegmentPort with ID: 8f56ac24-8c04-4bbd-b439-c7d0338161ae is going to be updated. [ 1164.698226] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.698512] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.698605] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.699022] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.699269] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.699522] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "port-8f56ac24-8c04-4bbd-b439-c7d0338161ae" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.726503] env[69232]: INFO networking_nsxv3.common.synchronization [req-bbb7a0b0-0dc0-4e40-a0c6-7072f669ed3b req-ca7c7445-9d8f-4051-becf-c31c7931d33b tempest-AttachInterfacesTestJSON-1442903876 tempest-AttachInterfacesTestJSON-1442903876-project-member] Enqueued Resource ID: 0909b11c-c2d6-4d46-9a46-74243fd12a97 with Priority: HIGHEST for action security_group_members [ 1164.726721] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0909b11c-c2d6-4d46-9a46-74243fd12a97 with Priority: HIGHEST for action security_group_members [ 1164.727210] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-0909b11c-c2d6-4d46-9a46-74243fd12a97 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.727360] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0909b11c-c2d6-4d46-9a46-74243fd12a97" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.727550] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0909b11c-c2d6-4d46-9a46-74243fd12a97" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.727642] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0909b11c-c2d6-4d46-9a46-74243fd12a97" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.727804] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.727921] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.727987] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.728147] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.728249] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.728348] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0909b11c-c2d6-4d46-9a46-74243fd12a97',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.230125] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.230289] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.230397] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.230651] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.260077] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.260377] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.260507] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.260573] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.260817] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.260846] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.260938] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0909b11c-c2d6-4d46-9a46-74243fd12a97 is going to be updated. [ 1165.292874] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.293044] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.293115] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.293355] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.293509] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.302895] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0909b11c-c2d6-4d46-9a46-74243fd12a97 in Status: IN_PROGRESS for 2s [ 1165.395711] env[69232]: INFO networking_nsxv3.common.synchronization [req-8568dd7c-bda1-40a8-b025-e32cda48e235 req-fae4cb55-9758-4648-91a3-f19e88136e07 service nova] Enqueued Resource ID: 5aeb42e6-43fc-4b3e-96b5-dc4a9cddb10c with Priority: HIGHEST for action security_group_rules [ 1165.395893] env[69232]: INFO networking_nsxv3.common.synchronization [req-8568dd7c-bda1-40a8-b025-e32cda48e235 req-fae4cb55-9758-4648-91a3-f19e88136e07 service nova] Enqueued Resource ID: 5aeb42e6-43fc-4b3e-96b5-dc4a9cddb10c with Priority: HIGHEST for action security_group_members [ 1165.396045] env[69232]: INFO networking_nsxv3.common.synchronization [req-8568dd7c-bda1-40a8-b025-e32cda48e235 req-fae4cb55-9758-4648-91a3-f19e88136e07 service nova] Enqueued Resource ID: 8f56ac24-8c04-4bbd-b439-c7d0338161ae with Priority: HIGHEST for action port [ 1165.396290] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5aeb42e6-43fc-4b3e-96b5-dc4a9cddb10c with Priority: HIGHEST for action security_group_rules [ 1165.396417] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5aeb42e6-43fc-4b3e-96b5-dc4a9cddb10c with Priority: HIGHEST for action security_group_members [ 1165.396514] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f56ac24-8c04-4bbd-b439-c7d0338161ae with Priority: HIGHEST for action port [ 1165.397078] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5aeb42e6-43fc-4b3e-96b5-dc4a9cddb10c taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.397208] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5aeb42e6-43fc-4b3e-96b5-dc4a9cddb10c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.397284] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5aeb42e6-43fc-4b3e-96b5-dc4a9cddb10c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.397471] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5aeb42e6-43fc-4b3e-96b5-dc4a9cddb10c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.397552] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5aeb42e6-43fc-4b3e-96b5-dc4a9cddb10c',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.398361] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-5aeb42e6-43fc-4b3e-96b5-dc4a9cddb10c taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.398473] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5aeb42e6-43fc-4b3e-96b5-dc4a9cddb10c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.398541] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5aeb42e6-43fc-4b3e-96b5-dc4a9cddb10c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.398696] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5aeb42e6-43fc-4b3e-96b5-dc4a9cddb10c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.398840] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.398926] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.398993] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.399140] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.399225] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.399310] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5aeb42e6-43fc-4b3e-96b5-dc4a9cddb10c',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.400421] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-8f56ac24-8c04-4bbd-b439-c7d0338161ae taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.400421] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8f56ac24-8c04-4bbd-b439-c7d0338161ae" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.400497] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8f56ac24-8c04-4bbd-b439-c7d0338161ae" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.400583] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8f56ac24-8c04-4bbd-b439-c7d0338161ae" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.400656] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8f56ac24-8c04-4bbd-b439-c7d0338161ae',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.682862] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 934b2684-b99c-4846-87df-66cbae10f2fc in Status: SUCCESS [ 1165.683262] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-934b2684-b99c-4846-87df-66cbae10f2fc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.905023] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-5aeb42e6-43fc-4b3e-96b5-dc4a9cddb10c taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.905023] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5aeb42e6-43fc-4b3e-96b5-dc4a9cddb10c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.905023] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5aeb42e6-43fc-4b3e-96b5-dc4a9cddb10c',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.905023] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8f56ac24-8c04-4bbd-b439-c7d0338161ae with status ACTIVE [ 1165.905023] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.905023] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.905023] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.905023] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.905023] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.905023] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.905556] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.905754] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.906060] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.906577] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.906885] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.907123] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.907275] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.907537] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.907713] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.907883] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8f56ac24-8c04-4bbd-b439-c7d0338161ae is going to be updated. [ 1165.931026] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.931317] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.931390] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.931606] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.931739] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.931915] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8f56ac24-8c04-4bbd-b439-c7d0338161ae" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.012618] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f5186e6-2d35-4ccf-a8b4-749a0a872128 in Status: SUCCESS [ 1166.012811] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.012972] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.013203] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.013449] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.013543] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.013584] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.013709] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.013789] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.013874] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.013965] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9f5186e6-2d35-4ccf-a8b4-749a0a872128',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.209503] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 714a2506-914c-4860-b68b-819348f723d0 in Status: SUCCESS [ 1166.209503] env[69232]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 714a2506-914c-4860-b68b-819348f723d0 deletion is rescheduled due to dependency. [ 1166.209503] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-714a2506-914c-4860-b68b-819348f723d0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.410405] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5aeb42e6-43fc-4b3e-96b5-dc4a9cddb10c',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.515929] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f5186e6-2d35-4ccf-a8b4-749a0a872128 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.516149] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.516212] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.516782] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.516782] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.516782] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.516782] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.517046] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.517046] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.517374] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.517453] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f5186e6-2d35-4ccf-a8b4-749a0a872128 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.517548] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.517599] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.517774] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.517957] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.517957] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.518102] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.518161] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.518225] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.518311] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.518403] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9f5186e6-2d35-4ccf-a8b4-749a0a872128',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.912656] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.913063] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.913063] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.913163] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.913257] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.913366] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5aeb42e6-43fc-4b3e-96b5-dc4a9cddb10c is going to be updated. [ 1166.945596] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.945734] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.945793] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.946039] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.946181] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.959299] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5aeb42e6-43fc-4b3e-96b5-dc4a9cddb10c in Status: IN_PROGRESS for 2s [ 1167.020514] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9f5186e6-2d35-4ccf-a8b4-749a0a872128: rpc.has_security_group_logging(os_id): False [ 1167.043917] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.044203] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.044304] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.045269] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.045373] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.045594] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.045726] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.045786] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.045953] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.046068] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.046291] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.046409] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.046465] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.046593] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.046683] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.046857] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.046969] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.047042] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.047200] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.047278] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.047483] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9f5186e6-2d35-4ccf-a8b4-749a0a872128 is going to be updated. [ 1167.144025] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.144025] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.144025] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.144025] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.144025] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.160831] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9f5186e6-2d35-4ccf-a8b4-749a0a872128 in Status: IN_PROGRESS for 2s [ 1167.313950] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0909b11c-c2d6-4d46-9a46-74243fd12a97 in Status: SUCCESS [ 1167.314244] env[69232]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0909b11c-c2d6-4d46-9a46-74243fd12a97 deletion is rescheduled due to dependency. [ 1167.314432] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0909b11c-c2d6-4d46-9a46-74243fd12a97" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.970019] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5aeb42e6-43fc-4b3e-96b5-dc4a9cddb10c in Status: SUCCESS [ 1168.970399] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5aeb42e6-43fc-4b3e-96b5-dc4a9cddb10c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.970446] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5aeb42e6-43fc-4b3e-96b5-dc4a9cddb10c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.970780] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5aeb42e6-43fc-4b3e-96b5-dc4a9cddb10c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.971058] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.971191] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.971262] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.971440] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.971525] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.971614] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5aeb42e6-43fc-4b3e-96b5-dc4a9cddb10c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.971711] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5aeb42e6-43fc-4b3e-96b5-dc4a9cddb10c',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.181083] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9f5186e6-2d35-4ccf-a8b4-749a0a872128 in Status: SUCCESS [ 1169.181339] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.474429] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5aeb42e6-43fc-4b3e-96b5-dc4a9cddb10c',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.977294] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5aeb42e6-43fc-4b3e-96b5-dc4a9cddb10c: rpc.has_security_group_logging(os_id): False [ 1169.998079] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.998256] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.998307] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.998509] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.024394] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.024394] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.024394] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.024394] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.024394] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.024394] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.024735] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5aeb42e6-43fc-4b3e-96b5-dc4a9cddb10c is going to be updated. [ 1170.088539] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.088756] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.088756] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.089048] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.089269] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.103706] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5aeb42e6-43fc-4b3e-96b5-dc4a9cddb10c in Status: IN_PROGRESS for 2s [ 1170.397929] env[69232]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1170.398193] env[69232]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1172.120555] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5aeb42e6-43fc-4b3e-96b5-dc4a9cddb10c in Status: SUCCESS [ 1172.121303] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5aeb42e6-43fc-4b3e-96b5-dc4a9cddb10c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.585565] env[69232]: INFO networking_nsxv3.common.synchronization [req-d9b4f3fe-f67c-43fd-b80a-267a6864a008 req-47a3d26f-3618-4241-826f-143b18c17041 tempest-ServersNegativeTestJSON-459402880 tempest-ServersNegativeTestJSON-459402880-project-member] Enqueued Resource ID: 83d1cdee-a934-490e-9869-707c6882be9d with Priority: HIGHEST for action security_group_members [ 1172.586261] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83d1cdee-a934-490e-9869-707c6882be9d with Priority: HIGHEST for action security_group_members [ 1172.587214] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-83d1cdee-a934-490e-9869-707c6882be9d taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.592109] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-83d1cdee-a934-490e-9869-707c6882be9d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.592109] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-83d1cdee-a934-490e-9869-707c6882be9d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.592109] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-83d1cdee-a934-490e-9869-707c6882be9d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.592109] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.592109] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.592109] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.592109] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.592109] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.592109] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('83d1cdee-a934-490e-9869-707c6882be9d',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.595352] env[69232]: INFO networking_nsxv3.common.synchronization [None req-52e4767b-62db-4916-8129-11a15d8c54ee tempest-AttachInterfacesTestJSON-1442903876 tempest-AttachInterfacesTestJSON-1442903876-project-member] Enqueued Resource ID: 20ba03af-aba0-4fe6-af1e-ea103067fcbe with Priority: HIGHEST for action security_group_members [ 1172.597331] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20ba03af-aba0-4fe6-af1e-ea103067fcbe with Priority: HIGHEST for action security_group_members [ 1172.597331] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-20ba03af-aba0-4fe6-af1e-ea103067fcbe taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.597331] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-20ba03af-aba0-4fe6-af1e-ea103067fcbe" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.597331] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-20ba03af-aba0-4fe6-af1e-ea103067fcbe" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.597331] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-20ba03af-aba0-4fe6-af1e-ea103067fcbe" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.597331] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.597783] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.597996] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.598304] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.598645] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.599051] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('20ba03af-aba0-4fe6-af1e-ea103067fcbe',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1173.094928] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.095127] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.095210] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.095422] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.095592] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.095829] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.095954] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.096058] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.096958] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.096958] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.096958] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 83d1cdee-a934-490e-9869-707c6882be9d is going to be updated. [ 1173.103823] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.104055] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.104162] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.104367] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.104493] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.104720] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.104826] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.104891] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.105077] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.105189] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.105311] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 20ba03af-aba0-4fe6-af1e-ea103067fcbe is going to be updated. [ 1173.132046] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.132046] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.132046] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.132046] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.132046] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.133255] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.133384] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.133466] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.133721] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.133871] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.151025] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 83d1cdee-a934-490e-9869-707c6882be9d in Status: IN_PROGRESS for 2s [ 1173.151025] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 20ba03af-aba0-4fe6-af1e-ea103067fcbe in Status: IN_PROGRESS for 2s [ 1175.164012] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 20ba03af-aba0-4fe6-af1e-ea103067fcbe in Status: SUCCESS [ 1175.164313] env[69232]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 20ba03af-aba0-4fe6-af1e-ea103067fcbe deletion is rescheduled due to dependency. [ 1175.164313] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-20ba03af-aba0-4fe6-af1e-ea103067fcbe" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.165187] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 83d1cdee-a934-490e-9869-707c6882be9d in Status: SUCCESS [ 1175.165337] env[69232]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 83d1cdee-a934-490e-9869-707c6882be9d deletion is rescheduled due to dependency. [ 1175.165434] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-83d1cdee-a934-490e-9869-707c6882be9d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.478294] env[69232]: INFO networking_nsxv3.common.synchronization [None req-82ae2efa-baec-46fd-8870-315a9d6a90d7 None None] Enqueued Resource ID: e95ae46a-8576-4398-b05d-261a4e709d1f with Priority: HIGHEST for action port [ 1176.478294] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e95ae46a-8576-4398-b05d-261a4e709d1f with Priority: HIGHEST for action port [ 1176.482868] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-e95ae46a-8576-4398-b05d-261a4e709d1f taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.483423] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e95ae46a-8576-4398-b05d-261a4e709d1f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.485138] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e95ae46a-8576-4398-b05d-261a4e709d1f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.485138] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e95ae46a-8576-4398-b05d-261a4e709d1f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.485138] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e95ae46a-8576-4398-b05d-261a4e709d1f',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.988340] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e95ae46a-8576-4398-b05d-261a4e709d1f [ 1176.988340] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.988340] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.988340] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.988340] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.988340] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.988579] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e95ae46a-8576-4398-b05d-261a4e709d1f already deleted. [ 1176.988579] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e95ae46a-8576-4398-b05d-261a4e709d1f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.442336] env[69232]: INFO networking_nsxv3.common.synchronization [req-53e41864-e3ce-445f-80e4-14fb8b6f67b5 req-83595271-4a5d-47a1-9acc-7de99a0d63ee tempest-ServersTestJSON-524901877 tempest-ServersTestJSON-524901877-project-member] Enqueued Resource ID: bdcc7a21-dd0d-4296-ac34-a880ea6123e7 with Priority: HIGHEST for action security_group_members [ 1177.443231] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdcc7a21-dd0d-4296-ac34-a880ea6123e7 with Priority: HIGHEST for action security_group_members [ 1177.443359] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.443426] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.443475] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.443966] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.443966] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.443966] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.443966] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.444209] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.444209] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.444277] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bdcc7a21-dd0d-4296-ac34-a880ea6123e7',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.869034] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock network-738 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.869516] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "network-738" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.869516] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "network-738" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.869882] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "network-738" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.872429] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.872704] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.872845] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.873160] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.873324] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.873571] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1177.873696] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] NeedRegenerationException {{(pid=69232) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1177.873810] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] no value, waiting for create lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1177.873923] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] value creation lock acquired {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1177.874051] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1177.874166] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Calling creation function for not-yet-present value {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1177.874306] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1177.903377] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1177.903768] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=69232) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1177.904020] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Released creation lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1177.904397] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "network-738" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.904883] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock port-26ac5679-64b4-4098-b9fb-823f78ae4aa8 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.905292] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "port-26ac5679-64b4-4098-b9fb-823f78ae4aa8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.905423] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "port-26ac5679-64b4-4098-b9fb-823f78ae4aa8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.905908] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "port-26ac5679-64b4-4098-b9fb-823f78ae4aa8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.906178] env[69232]: DEBUG networking_nsxv3.api.rpc [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('26ac5679-64b4-4098-b9fb-823f78ae4aa8',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.946464] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bdcc7a21-dd0d-4296-ac34-a880ea6123e7',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.413022] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.413022] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.413022] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.413279] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.413665] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.413948] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Segment Port 26ac5679-64b4-4098-b9fb-823f78ae4aa8 not found, creating... [ 1178.415100] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.415100] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.421542] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.421542] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.421542] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.421542] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.421542] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.421542] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.421542] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.421542] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.421542] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Resource: SegmentPort with ID: 26ac5679-64b4-4098-b9fb-823f78ae4aa8 is going to be created. [ 1178.448548] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.448714] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.448868] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.449166] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.449566] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.449662] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "port-26ac5679-64b4-4098-b9fb-823f78ae4aa8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.450690] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bdcc7a21-dd0d-4296-ac34-a880ea6123e7',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.529945] env[69232]: INFO networking_nsxv3.common.synchronization [None req-5f576fd0-f926-4b19-bb14-4b3842bf2a17 None None] Enqueued Resource ID: 68bd0d6c-2ae7-44c9-bd35-8d1160a3a17a with Priority: HIGHEST for action port [ 1178.531053] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68bd0d6c-2ae7-44c9-bd35-8d1160a3a17a with Priority: HIGHEST for action port [ 1178.531053] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-68bd0d6c-2ae7-44c9-bd35-8d1160a3a17a taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.531450] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-68bd0d6c-2ae7-44c9-bd35-8d1160a3a17a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.531450] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-68bd0d6c-2ae7-44c9-bd35-8d1160a3a17a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.531509] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-68bd0d6c-2ae7-44c9-bd35-8d1160a3a17a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.531630] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('68bd0d6c-2ae7-44c9-bd35-8d1160a3a17a',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.698383] env[69232]: INFO networking_nsxv3.common.synchronization [req-60f4c294-1fd9-4fdb-bdc7-3ae31127c4f3 req-c3044ef8-229c-4812-b4f5-8ba4f5e8a127 tempest-ServerActionsTestJSON-973196373 tempest-ServerActionsTestJSON-973196373-project-member] Enqueued Resource ID: 1eb9f24d-331e-450b-9da0-82652ecba032 with Priority: HIGHEST for action security_group_members [ 1178.698819] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1eb9f24d-331e-450b-9da0-82652ecba032 with Priority: HIGHEST for action security_group_members [ 1178.699361] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-1eb9f24d-331e-450b-9da0-82652ecba032 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.699361] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1eb9f24d-331e-450b-9da0-82652ecba032" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.699361] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1eb9f24d-331e-450b-9da0-82652ecba032" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.699563] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1eb9f24d-331e-450b-9da0-82652ecba032" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.700116] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.700116] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.700116] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.700116] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.700116] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.702276] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1eb9f24d-331e-450b-9da0-82652ecba032',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.957304] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.957583] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.957583] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.957755] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.957850] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.957951] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bdcc7a21-dd0d-4296-ac34-a880ea6123e7 is going to be updated. [ 1178.988314] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.988478] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.988550] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.988774] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.988900] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.002223] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bdcc7a21-dd0d-4296-ac34-a880ea6123e7 in Status: IN_PROGRESS for 2s [ 1179.034543] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 68bd0d6c-2ae7-44c9-bd35-8d1160a3a17a [ 1179.034801] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.035193] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.035193] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.035306] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.035338] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.035432] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:68bd0d6c-2ae7-44c9-bd35-8d1160a3a17a already deleted. [ 1179.035517] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-68bd0d6c-2ae7-44c9-bd35-8d1160a3a17a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.175682] env[69232]: INFO networking_nsxv3.common.synchronization [req-53e41864-e3ce-445f-80e4-14fb8b6f67b5 req-b3e64244-5807-48cb-87a5-b81099b83f78 service nova] Enqueued Resource ID: bdcc7a21-dd0d-4296-ac34-a880ea6123e7 with Priority: HIGHEST for action security_group_rules [ 1179.175682] env[69232]: INFO networking_nsxv3.common.synchronization [req-53e41864-e3ce-445f-80e4-14fb8b6f67b5 req-b3e64244-5807-48cb-87a5-b81099b83f78 service nova] Enqueued Resource ID: bdcc7a21-dd0d-4296-ac34-a880ea6123e7 with Priority: HIGHEST for action security_group_members [ 1179.175682] env[69232]: INFO networking_nsxv3.common.synchronization [req-53e41864-e3ce-445f-80e4-14fb8b6f67b5 req-b3e64244-5807-48cb-87a5-b81099b83f78 service nova] Enqueued Resource ID: 26ac5679-64b4-4098-b9fb-823f78ae4aa8 with Priority: HIGHEST for action port [ 1179.175682] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdcc7a21-dd0d-4296-ac34-a880ea6123e7 with Priority: HIGHEST for action security_group_rules [ 1179.175682] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdcc7a21-dd0d-4296-ac34-a880ea6123e7 with Priority: HIGHEST for action security_group_members [ 1179.175682] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 26ac5679-64b4-4098-b9fb-823f78ae4aa8 with Priority: HIGHEST for action port [ 1179.175682] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bdcc7a21-dd0d-4296-ac34-a880ea6123e7 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.175682] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.175682] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.175682] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.175682] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bdcc7a21-dd0d-4296-ac34-a880ea6123e7',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.177660] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.177803] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.178404] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-26ac5679-64b4-4098-b9fb-823f78ae4aa8 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.178404] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-26ac5679-64b4-4098-b9fb-823f78ae4aa8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.178404] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-26ac5679-64b4-4098-b9fb-823f78ae4aa8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.178404] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-26ac5679-64b4-4098-b9fb-823f78ae4aa8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.178622] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('26ac5679-64b4-4098-b9fb-823f78ae4aa8',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.204145] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.204570] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.204570] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.204570] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.229626] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.229626] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.229626] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.229626] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.229626] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.229626] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.229626] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1eb9f24d-331e-450b-9da0-82652ecba032 is going to be updated. [ 1179.259133] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.259133] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.259133] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.259133] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.259133] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.269664] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1eb9f24d-331e-450b-9da0-82652ecba032 in Status: IN_PROGRESS for 2s [ 1179.338680] env[69232]: INFO networking_nsxv3.common.synchronization [None req-1e156b82-c3c0-4168-8176-31f752b8fa05 None None] Enqueued Resource ID: 879b27a0-999f-463d-9757-0f7cee7d157d with Priority: HIGHEST for action port [ 1179.338680] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 879b27a0-999f-463d-9757-0f7cee7d157d with Priority: HIGHEST for action port [ 1179.338680] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-879b27a0-999f-463d-9757-0f7cee7d157d taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.338680] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-879b27a0-999f-463d-9757-0f7cee7d157d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.338680] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-879b27a0-999f-463d-9757-0f7cee7d157d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.338680] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-879b27a0-999f-463d-9757-0f7cee7d157d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.338680] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('879b27a0-999f-463d-9757-0f7cee7d157d',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.678075] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.678355] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.680764] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 26ac5679-64b4-4098-b9fb-823f78ae4aa8 with status ACTIVE [ 1179.681054] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.681212] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.681318] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.681552] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.681671] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.681885] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.682019] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.682099] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.682254] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.682340] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.682563] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.682682] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.682735] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.682913] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.683031] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.683149] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 26ac5679-64b4-4098-b9fb-823f78ae4aa8 is going to be updated. [ 1179.706954] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.707234] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.707234] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.707389] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.707525] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.707713] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-26ac5679-64b4-4098-b9fb-823f78ae4aa8" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.778474] env[69232]: INFO networking_nsxv3.common.synchronization [None req-ce9e91f7-3274-4541-af7e-3fa956ccd959 tempest-AttachVolumeTestJSON-1679696077 tempest-AttachVolumeTestJSON-1679696077-project-member] Enqueued Resource ID: 3a73f146-1767-411a-a1ec-f992285edea0 with Priority: HIGHEST for action security_group_rules [ 1179.779070] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a73f146-1767-411a-a1ec-f992285edea0 with Priority: HIGHEST for action security_group_rules [ 1179.780034] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3a73f146-1767-411a-a1ec-f992285edea0 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.780169] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3a73f146-1767-411a-a1ec-f992285edea0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.780238] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3a73f146-1767-411a-a1ec-f992285edea0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.780513] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3a73f146-1767-411a-a1ec-f992285edea0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.780571] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3a73f146-1767-411a-a1ec-f992285edea0',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.841563] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 879b27a0-999f-463d-9757-0f7cee7d157d [ 1179.841814] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.841951] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.842032] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.842248] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.842488] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.842574] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:879b27a0-999f-463d-9757-0f7cee7d157d already deleted. [ 1179.842750] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-879b27a0-999f-463d-9757-0f7cee7d157d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.873597] env[69232]: INFO networking_nsxv3.common.synchronization [None req-a65f60e7-e51d-41b6-bcc3-ba534d6eb80f tempest-AttachVolumeTestJSON-1679696077 tempest-AttachVolumeTestJSON-1679696077-project-member] Enqueued Resource ID: 3a73f146-1767-411a-a1ec-f992285edea0 with Priority: HIGHEST for action security_group_rules [ 1179.874274] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a73f146-1767-411a-a1ec-f992285edea0 with Priority: HIGHEST for action security_group_rules [ 1179.874988] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3a73f146-1767-411a-a1ec-f992285edea0 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.874988] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3a73f146-1767-411a-a1ec-f992285edea0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.303767] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.304080] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.304080] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.304233] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.304275] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.304422] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3a73f146-1767-411a-a1ec-f992285edea0 already deleted. [ 1180.304492] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3a73f146-1767-411a-a1ec-f992285edea0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.304684] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3a73f146-1767-411a-a1ec-f992285edea0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.305046] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3a73f146-1767-411a-a1ec-f992285edea0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.305046] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3a73f146-1767-411a-a1ec-f992285edea0',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.421986] env[69232]: INFO networking_nsxv3.common.synchronization [None req-27cb41c0-5e0a-4e85-935d-e855cfc56d05 None None] Enqueued Resource ID: 72f5f693-795f-4ca2-adcc-d7027adb372a with Priority: HIGHEST for action port [ 1180.422502] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72f5f693-795f-4ca2-adcc-d7027adb372a with Priority: HIGHEST for action port [ 1180.423193] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-72f5f693-795f-4ca2-adcc-d7027adb372a taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.423193] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-72f5f693-795f-4ca2-adcc-d7027adb372a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.423193] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-72f5f693-795f-4ca2-adcc-d7027adb372a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.423872] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-72f5f693-795f-4ca2-adcc-d7027adb372a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.423965] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('72f5f693-795f-4ca2-adcc-d7027adb372a',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.844726] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.844931] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.845104] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.845404] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.845606] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.849420] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3a73f146-1767-411a-a1ec-f992285edea0 already deleted. [ 1180.849420] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3a73f146-1767-411a-a1ec-f992285edea0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.926617] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 72f5f693-795f-4ca2-adcc-d7027adb372a [ 1180.927685] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.927685] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.927685] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.927685] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.927685] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.928147] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:72f5f693-795f-4ca2-adcc-d7027adb372a already deleted. [ 1180.928147] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-72f5f693-795f-4ca2-adcc-d7027adb372a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.013744] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bdcc7a21-dd0d-4296-ac34-a880ea6123e7 in Status: SUCCESS [ 1181.015051] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.015051] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.015051] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.015051] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.015051] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.015051] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.015347] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.015347] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.015407] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bdcc7a21-dd0d-4296-ac34-a880ea6123e7',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.283878] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1eb9f24d-331e-450b-9da0-82652ecba032 in Status: SUCCESS [ 1181.284082] env[69232]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1eb9f24d-331e-450b-9da0-82652ecba032 deletion is rescheduled due to dependency. [ 1181.284212] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1eb9f24d-331e-450b-9da0-82652ecba032" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.520509] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bdcc7a21-dd0d-4296-ac34-a880ea6123e7',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1182.020992] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bdcc7a21-dd0d-4296-ac34-a880ea6123e7',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1182.525104] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.525420] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.525420] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.525570] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.525687] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.525790] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bdcc7a21-dd0d-4296-ac34-a880ea6123e7 is going to be updated. [ 1182.554813] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.554958] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.555079] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.555243] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.555387] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.566427] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bdcc7a21-dd0d-4296-ac34-a880ea6123e7 in Status: IN_PROGRESS for 2s [ 1183.863669] env[69232]: INFO networking_nsxv3.common.synchronization [req-9f84d67b-bc70-49d3-8eb6-ce3ac4042643 req-e7422d0f-33c3-4fbc-ada7-07feba902e34 tempest-ServerMetadataTestJSON-6378904 tempest-ServerMetadataTestJSON-6378904-project-member] Enqueued Resource ID: 51642e84-0020-4045-91ab-e7c13f6d7a75 with Priority: HIGHEST for action security_group_members [ 1183.863950] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 51642e84-0020-4045-91ab-e7c13f6d7a75 with Priority: HIGHEST for action security_group_members [ 1183.864330] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-51642e84-0020-4045-91ab-e7c13f6d7a75 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.864453] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-51642e84-0020-4045-91ab-e7c13f6d7a75" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.864697] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-51642e84-0020-4045-91ab-e7c13f6d7a75" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.864857] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-51642e84-0020-4045-91ab-e7c13f6d7a75" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.865063] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.865209] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.865423] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.865640] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.865897] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.866039] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('51642e84-0020-4045-91ab-e7c13f6d7a75',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1184.341497] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock network-145 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.341704] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "network-145" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.341820] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "network-145" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.342356] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "network-145" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.342646] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.342891] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.342948] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.343194] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.343351] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.343576] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1184.343700] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] NeedRegenerationException {{(pid=69232) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1184.343820] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] no value, waiting for create lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1184.343931] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] value creation lock acquired {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1184.344060] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1184.344178] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Calling creation function for not-yet-present value {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1184.344316] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1184.364258] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1184.364482] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69232) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1184.364787] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Released creation lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1184.365073] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "network-145" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.365441] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock port-19680afb-90fb-40e7-bbcd-2db4edf9fbe3 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.365656] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "port-19680afb-90fb-40e7-bbcd-2db4edf9fbe3" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.365798] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "port-19680afb-90fb-40e7-bbcd-2db4edf9fbe3" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.366194] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "port-19680afb-90fb-40e7-bbcd-2db4edf9fbe3" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.366371] env[69232]: DEBUG networking_nsxv3.api.rpc [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('19680afb-90fb-40e7-bbcd-2db4edf9fbe3',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1184.368290] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.368290] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.368290] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.368290] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.368501] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.368532] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.368631] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.368809] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.368990] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.369128] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.369237] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 51642e84-0020-4045-91ab-e7c13f6d7a75 already deleted. [ 1184.369316] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-51642e84-0020-4045-91ab-e7c13f6d7a75" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.581414] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bdcc7a21-dd0d-4296-ac34-a880ea6123e7 in Status: SUCCESS [ 1184.581654] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.581835] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.582099] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.582289] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.582412] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.582535] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.582670] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.582756] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.582866] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.582923] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bdcc7a21-dd0d-4296-ac34-a880ea6123e7',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1184.870612] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.871054] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.871054] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.871318] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.871479] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.871644] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Segment Port 19680afb-90fb-40e7-bbcd-2db4edf9fbe3 not found, creating... [ 1184.871918] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.872094] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.872231] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.872452] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.872624] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.872911] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.873081] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.873203] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.873412] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.873550] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.873716] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Resource: SegmentPort with ID: 19680afb-90fb-40e7-bbcd-2db4edf9fbe3 is going to be created. [ 1184.895207] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.895414] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.895545] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.895941] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.896675] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.896675] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "port-19680afb-90fb-40e7-bbcd-2db4edf9fbe3" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.085431] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.085711] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.085711] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.085978] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.086175] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.086287] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.086350] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.086493] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.086591] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.086664] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.086858] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.086972] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.087040] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.087205] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.087347] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.087432] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.087483] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.087626] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.087719] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.087789] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.087885] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bdcc7a21-dd0d-4296-ac34-a880ea6123e7',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1185.590414] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bdcc7a21-dd0d-4296-ac34-a880ea6123e7: rpc.has_security_group_logging(os_id): False [ 1185.607629] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.607769] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.607841] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.608076] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.608173] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.608382] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.608940] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.608940] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.608940] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.608940] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.608940] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.609176] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.609176] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.609252] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.609286] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.609461] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.609554] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.609616] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.609756] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.609830] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.609915] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bdcc7a21-dd0d-4296-ac34-a880ea6123e7 is going to be updated. [ 1185.671633] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.671841] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.671915] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.672153] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.672304] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.708282] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bdcc7a21-dd0d-4296-ac34-a880ea6123e7 in Status: IN_PROGRESS for 2s [ 1185.784989] env[69232]: INFO networking_nsxv3.common.synchronization [req-9f84d67b-bc70-49d3-8eb6-ce3ac4042643 req-e77ad1d2-7a0b-49f4-a2a0-e786e8e7d189 service nova] Enqueued Resource ID: 51642e84-0020-4045-91ab-e7c13f6d7a75 with Priority: HIGHEST for action security_group_rules [ 1185.785201] env[69232]: INFO networking_nsxv3.common.synchronization [req-9f84d67b-bc70-49d3-8eb6-ce3ac4042643 req-e77ad1d2-7a0b-49f4-a2a0-e786e8e7d189 service nova] Enqueued Resource ID: 51642e84-0020-4045-91ab-e7c13f6d7a75 with Priority: HIGHEST for action security_group_members [ 1185.785414] env[69232]: INFO networking_nsxv3.common.synchronization [req-9f84d67b-bc70-49d3-8eb6-ce3ac4042643 req-e77ad1d2-7a0b-49f4-a2a0-e786e8e7d189 service nova] Enqueued Resource ID: 19680afb-90fb-40e7-bbcd-2db4edf9fbe3 with Priority: HIGHEST for action port [ 1185.785717] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 51642e84-0020-4045-91ab-e7c13f6d7a75 with Priority: HIGHEST for action security_group_rules [ 1185.785856] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 51642e84-0020-4045-91ab-e7c13f6d7a75 with Priority: HIGHEST for action security_group_members [ 1185.785967] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19680afb-90fb-40e7-bbcd-2db4edf9fbe3 with Priority: HIGHEST for action port [ 1185.786653] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-51642e84-0020-4045-91ab-e7c13f6d7a75 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.786798] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-51642e84-0020-4045-91ab-e7c13f6d7a75" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.786857] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-51642e84-0020-4045-91ab-e7c13f6d7a75" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.787116] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-51642e84-0020-4045-91ab-e7c13f6d7a75" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.787305] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('51642e84-0020-4045-91ab-e7c13f6d7a75',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1185.788448] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-51642e84-0020-4045-91ab-e7c13f6d7a75 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.788574] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-51642e84-0020-4045-91ab-e7c13f6d7a75" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.788633] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-51642e84-0020-4045-91ab-e7c13f6d7a75" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.790020] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-51642e84-0020-4045-91ab-e7c13f6d7a75" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.790020] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.790020] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.790020] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.790020] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.790020] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.790020] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('51642e84-0020-4045-91ab-e7c13f6d7a75',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1185.790430] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-19680afb-90fb-40e7-bbcd-2db4edf9fbe3 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.790430] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-19680afb-90fb-40e7-bbcd-2db4edf9fbe3" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.790430] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-19680afb-90fb-40e7-bbcd-2db4edf9fbe3" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.790603] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-19680afb-90fb-40e7-bbcd-2db4edf9fbe3" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.790651] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('19680afb-90fb-40e7-bbcd-2db4edf9fbe3',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1186.070163] env[69232]: INFO networking_nsxv3.common.synchronization [req-d275ca82-f5bd-466e-92d1-302011a01521 req-00ca944d-6c95-49cc-a26f-6505bb120662 tempest-AttachVolumeTestJSON-1679696077 tempest-AttachVolumeTestJSON-1679696077-project-member] Enqueued Resource ID: 3a73f146-1767-411a-a1ec-f992285edea0 with Priority: HIGHEST for action security_group_members [ 1186.071132] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a73f146-1767-411a-a1ec-f992285edea0 with Priority: HIGHEST for action security_group_members [ 1186.071225] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a73f146-1767-411a-a1ec-f992285edea0 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.071326] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a73f146-1767-411a-a1ec-f992285edea0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.071326] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a73f146-1767-411a-a1ec-f992285edea0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.071582] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a73f146-1767-411a-a1ec-f992285edea0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.072537] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.072537] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.072537] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.072537] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.072537] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.072537] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3a73f146-1767-411a-a1ec-f992285edea0',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1186.292591] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-51642e84-0020-4045-91ab-e7c13f6d7a75 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.292591] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-51642e84-0020-4045-91ab-e7c13f6d7a75" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.292591] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('51642e84-0020-4045-91ab-e7c13f6d7a75',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1186.293397] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 19680afb-90fb-40e7-bbcd-2db4edf9fbe3 with status ACTIVE [ 1186.293573] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.293683] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.293746] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.293944] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.294041] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.294212] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.294303] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.294360] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.294508] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.294580] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.294831] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.294920] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.295487] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.295708] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.295802] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.295891] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 19680afb-90fb-40e7-bbcd-2db4edf9fbe3 is going to be updated. [ 1186.322529] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.322788] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.322911] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.323271] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.323515] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.323768] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-19680afb-90fb-40e7-bbcd-2db4edf9fbe3" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.406169] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock network-979 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.406373] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "network-979" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.406505] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "network-979" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.406843] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "network-979" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.407310] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.407500] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.407612] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.407843] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.407997] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.408233] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1186.408642] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] NeedRegenerationException {{(pid=69232) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1186.408796] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] no value, waiting for create lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1186.408915] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] value creation lock acquired {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1186.409187] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1186.409316] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Calling creation function for not-yet-present value {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1186.409458] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1186.429518] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1186.429686] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69232) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1186.429835] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Released creation lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1186.430074] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "network-979" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.430429] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock port-6ee40e3e-ebcd-44b6-bfb1-45caee6b035f taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.430612] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "port-6ee40e3e-ebcd-44b6-bfb1-45caee6b035f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.430742] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "port-6ee40e3e-ebcd-44b6-bfb1-45caee6b035f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.431099] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "port-6ee40e3e-ebcd-44b6-bfb1-45caee6b035f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.431317] env[69232]: DEBUG networking_nsxv3.api.rpc [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6ee40e3e-ebcd-44b6-bfb1-45caee6b035f',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1186.574933] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.575133] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.575190] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.575403] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.575500] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.575737] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.575840] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.575894] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.576068] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.576143] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.576234] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3a73f146-1767-411a-a1ec-f992285edea0 already deleted. [ 1186.576314] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a73f146-1767-411a-a1ec-f992285edea0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.798890] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('51642e84-0020-4045-91ab-e7c13f6d7a75',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1186.933705] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.934098] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.934248] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.934535] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.934746] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.934917] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Segment Port 6ee40e3e-ebcd-44b6-bfb1-45caee6b035f not found, creating... [ 1186.935201] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.935369] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.935494] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.935764] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.935921] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.936225] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.936387] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.936509] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.936726] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.936868] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.937646] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Resource: SegmentPort with ID: 6ee40e3e-ebcd-44b6-bfb1-45caee6b035f is going to be created. [ 1186.965022] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.965571] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.965842] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.966141] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.966383] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.966643] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "port-6ee40e3e-ebcd-44b6-bfb1-45caee6b035f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.301933] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.302251] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.302251] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.302578] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.302652] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.302781] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 51642e84-0020-4045-91ab-e7c13f6d7a75 is going to be created. [ 1187.326141] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.326293] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.326390] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.326613] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.326792] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.336936] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 51642e84-0020-4045-91ab-e7c13f6d7a75 in Status: UNINITIALIZED for 2s [ 1187.654487] env[69232]: INFO networking_nsxv3.common.synchronization [req-d275ca82-f5bd-466e-92d1-302011a01521 req-b32ff466-5c82-4332-9cf1-8293b35e5a64 service nova] Enqueued Resource ID: 3a73f146-1767-411a-a1ec-f992285edea0 with Priority: HIGHEST for action security_group_rules [ 1187.654723] env[69232]: INFO networking_nsxv3.common.synchronization [req-d275ca82-f5bd-466e-92d1-302011a01521 req-b32ff466-5c82-4332-9cf1-8293b35e5a64 service nova] Enqueued Resource ID: 3a73f146-1767-411a-a1ec-f992285edea0 with Priority: HIGHEST for action security_group_members [ 1187.654915] env[69232]: INFO networking_nsxv3.common.synchronization [req-d275ca82-f5bd-466e-92d1-302011a01521 req-b32ff466-5c82-4332-9cf1-8293b35e5a64 service nova] Enqueued Resource ID: 6ee40e3e-ebcd-44b6-bfb1-45caee6b035f with Priority: HIGHEST for action port [ 1187.655507] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a73f146-1767-411a-a1ec-f992285edea0 with Priority: HIGHEST for action security_group_rules [ 1187.655763] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a73f146-1767-411a-a1ec-f992285edea0 with Priority: HIGHEST for action security_group_members [ 1187.655933] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ee40e3e-ebcd-44b6-bfb1-45caee6b035f with Priority: HIGHEST for action port [ 1187.657224] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3a73f146-1767-411a-a1ec-f992285edea0 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.657357] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3a73f146-1767-411a-a1ec-f992285edea0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.657428] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3a73f146-1767-411a-a1ec-f992285edea0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.657640] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3a73f146-1767-411a-a1ec-f992285edea0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.657728] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3a73f146-1767-411a-a1ec-f992285edea0',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.658585] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a73f146-1767-411a-a1ec-f992285edea0 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.658706] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a73f146-1767-411a-a1ec-f992285edea0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.658776] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a73f146-1767-411a-a1ec-f992285edea0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.658956] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a73f146-1767-411a-a1ec-f992285edea0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.659118] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.659212] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.659271] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.659408] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.659490] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.659577] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3a73f146-1767-411a-a1ec-f992285edea0',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.660853] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-6ee40e3e-ebcd-44b6-bfb1-45caee6b035f taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.660853] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6ee40e3e-ebcd-44b6-bfb1-45caee6b035f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.660853] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6ee40e3e-ebcd-44b6-bfb1-45caee6b035f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.661018] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6ee40e3e-ebcd-44b6-bfb1-45caee6b035f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.661058] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6ee40e3e-ebcd-44b6-bfb1-45caee6b035f',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.728745] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bdcc7a21-dd0d-4296-ac34-a880ea6123e7 in Status: SUCCESS [ 1187.729064] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.163378] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3a73f146-1767-411a-a1ec-f992285edea0',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1188.164891] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a73f146-1767-411a-a1ec-f992285edea0 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.165023] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a73f146-1767-411a-a1ec-f992285edea0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.165183] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6ee40e3e-ebcd-44b6-bfb1-45caee6b035f with status ACTIVE [ 1188.165343] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.165489] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.165528] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.165734] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.165773] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.166221] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.166221] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.166221] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.166373] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.167286] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.167405] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.167510] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.167577] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.167744] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.167826] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.167915] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6ee40e3e-ebcd-44b6-bfb1-45caee6b035f is going to be updated. [ 1188.189516] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.189765] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.189856] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.190076] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.190211] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.190372] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6ee40e3e-ebcd-44b6-bfb1-45caee6b035f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.671577] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3a73f146-1767-411a-a1ec-f992285edea0',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1188.735393] env[69232]: INFO networking_nsxv3.common.synchronization [req-645d4ab7-b679-41b9-b41b-94a95854d21e req-d8ef6743-62ba-4a53-aaa6-fd1c6c67770c tempest-ServerActionsTestJSON-973196373 tempest-ServerActionsTestJSON-973196373-project-member] Enqueued Resource ID: 1eb9f24d-331e-450b-9da0-82652ecba032 with Priority: HIGHEST for action security_group_members [ 1188.736118] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1eb9f24d-331e-450b-9da0-82652ecba032 with Priority: HIGHEST for action security_group_members [ 1188.736636] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-1eb9f24d-331e-450b-9da0-82652ecba032 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.736770] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1eb9f24d-331e-450b-9da0-82652ecba032" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.736857] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1eb9f24d-331e-450b-9da0-82652ecba032" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.737132] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1eb9f24d-331e-450b-9da0-82652ecba032" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.737293] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.737486] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.737540] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.737704] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.737835] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.737955] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1eb9f24d-331e-450b-9da0-82652ecba032',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1189.081051] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock network-892 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.081295] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "network-892" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.081513] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "network-892" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.081813] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "network-892" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.082252] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.082546] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.083412] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.083412] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.083412] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.084423] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1189.084423] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] NeedRegenerationException {{(pid=69232) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1189.084581] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] no value, waiting for create lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1189.084654] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] value creation lock acquired {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1189.084897] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1189.085077] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Calling creation function for not-yet-present value {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1189.085230] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1189.106366] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1189.106542] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69232) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1189.106698] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Released creation lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1189.106864] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "network-892" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.107278] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock port-ed604863-9f2b-46cd-939c-7df676073bde taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.107467] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "port-ed604863-9f2b-46cd-939c-7df676073bde" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.107595] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "port-ed604863-9f2b-46cd-939c-7df676073bde" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.107936] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "port-ed604863-9f2b-46cd-939c-7df676073bde" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.108103] env[69232]: DEBUG networking_nsxv3.api.rpc [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ed604863-9f2b-46cd-939c-7df676073bde',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1189.173825] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.174103] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.174103] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.174289] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.174380] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.174953] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3a73f146-1767-411a-a1ec-f992285edea0 is going to be created. [ 1189.202302] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.202497] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.202560] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.202839] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.203010] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.213560] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3a73f146-1767-411a-a1ec-f992285edea0 in Status: UNINITIALIZED for 2s [ 1189.240729] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.240970] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.241046] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.241293] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.241409] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.241671] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.241808] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.241897] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.242102] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.242190] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.242322] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1eb9f24d-331e-450b-9da0-82652ecba032 is going to be updated. [ 1189.283467] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.283656] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.283714] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.283890] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.284043] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.296903] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1eb9f24d-331e-450b-9da0-82652ecba032 in Status: IN_PROGRESS for 2s [ 1189.349361] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 51642e84-0020-4045-91ab-e7c13f6d7a75 in Status: SUCCESS [ 1189.349539] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-51642e84-0020-4045-91ab-e7c13f6d7a75" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.349605] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-51642e84-0020-4045-91ab-e7c13f6d7a75" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.349807] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-51642e84-0020-4045-91ab-e7c13f6d7a75" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.349986] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.350129] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.350202] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.350900] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.350900] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.350900] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-51642e84-0020-4045-91ab-e7c13f6d7a75" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.350900] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('51642e84-0020-4045-91ab-e7c13f6d7a75',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1189.613568] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.613568] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.613568] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.613568] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.613568] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.613905] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Segment Port ed604863-9f2b-46cd-939c-7df676073bde not found, creating... [ 1189.614096] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.614345] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.614532] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.614922] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.615047] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.615432] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.615643] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.615803] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.616122] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.616310] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.616602] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Resource: SegmentPort with ID: ed604863-9f2b-46cd-939c-7df676073bde is going to be created. [ 1189.638552] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.639025] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.639185] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.639529] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.639805] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.640075] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "port-ed604863-9f2b-46cd-939c-7df676073bde" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.853665] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-51642e84-0020-4045-91ab-e7c13f6d7a75 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.854130] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-51642e84-0020-4045-91ab-e7c13f6d7a75" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.854130] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-51642e84-0020-4045-91ab-e7c13f6d7a75" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.854130] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-51642e84-0020-4045-91ab-e7c13f6d7a75" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.854310] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.854465] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.854579] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.854639] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.854783] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.854880] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-51642e84-0020-4045-91ab-e7c13f6d7a75" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.855054] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-51642e84-0020-4045-91ab-e7c13f6d7a75 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.855157] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-51642e84-0020-4045-91ab-e7c13f6d7a75" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.855221] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-51642e84-0020-4045-91ab-e7c13f6d7a75" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.855392] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-51642e84-0020-4045-91ab-e7c13f6d7a75" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.855541] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.855635] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.855708] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.855912] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.855986] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.856068] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-51642e84-0020-4045-91ab-e7c13f6d7a75" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.856172] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('51642e84-0020-4045-91ab-e7c13f6d7a75',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1190.348570] env[69232]: INFO networking_nsxv3.common.synchronization [req-645d4ab7-b679-41b9-b41b-94a95854d21e req-ba57b6e8-b97b-41a1-914a-2576918daa29 service nova] Enqueued Resource ID: 1eb9f24d-331e-450b-9da0-82652ecba032 with Priority: HIGHEST for action security_group_rules [ 1190.348763] env[69232]: INFO networking_nsxv3.common.synchronization [req-645d4ab7-b679-41b9-b41b-94a95854d21e req-ba57b6e8-b97b-41a1-914a-2576918daa29 service nova] Enqueued Resource ID: 1eb9f24d-331e-450b-9da0-82652ecba032 with Priority: HIGHEST for action security_group_members [ 1190.348906] env[69232]: INFO networking_nsxv3.common.synchronization [req-645d4ab7-b679-41b9-b41b-94a95854d21e req-ba57b6e8-b97b-41a1-914a-2576918daa29 service nova] Enqueued Resource ID: ed604863-9f2b-46cd-939c-7df676073bde with Priority: HIGHEST for action port [ 1190.349160] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1eb9f24d-331e-450b-9da0-82652ecba032 with Priority: HIGHEST for action security_group_rules [ 1190.349288] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1eb9f24d-331e-450b-9da0-82652ecba032 with Priority: HIGHEST for action security_group_members [ 1190.349383] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed604863-9f2b-46cd-939c-7df676073bde with Priority: HIGHEST for action port [ 1190.349990] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1eb9f24d-331e-450b-9da0-82652ecba032 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.350157] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1eb9f24d-331e-450b-9da0-82652ecba032" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.350286] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1eb9f24d-331e-450b-9da0-82652ecba032" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.350430] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1eb9f24d-331e-450b-9da0-82652ecba032" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.350513] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1eb9f24d-331e-450b-9da0-82652ecba032',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1190.351319] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-1eb9f24d-331e-450b-9da0-82652ecba032 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.351417] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1eb9f24d-331e-450b-9da0-82652ecba032" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.351609] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-ed604863-9f2b-46cd-939c-7df676073bde taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.354561] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ed604863-9f2b-46cd-939c-7df676073bde" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.354639] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ed604863-9f2b-46cd-939c-7df676073bde" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.354876] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ed604863-9f2b-46cd-939c-7df676073bde" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.354964] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ed604863-9f2b-46cd-939c-7df676073bde',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1190.358547] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 51642e84-0020-4045-91ab-e7c13f6d7a75: rpc.has_security_group_logging(os_id): False [ 1190.377658] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.377845] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.377998] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.378170] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.378304] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.378573] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.378701] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.378796] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.379017] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.379147] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.379488] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.379488] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.379602] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.379649] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.379737] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.379890] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.380008] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.380122] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.380280] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.380356] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.380442] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 51642e84-0020-4045-91ab-e7c13f6d7a75 is going to be created. [ 1190.449151] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.449485] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.449591] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.449808] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.450576] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.466577] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 51642e84-0020-4045-91ab-e7c13f6d7a75 in Status: IN_PROGRESS for 2s [ 1190.857537] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-1eb9f24d-331e-450b-9da0-82652ecba032 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.857924] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1eb9f24d-331e-450b-9da0-82652ecba032" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.857924] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ed604863-9f2b-46cd-939c-7df676073bde with status ACTIVE [ 1190.858054] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.858155] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.858219] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.858423] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.858510] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.858678] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.858773] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.858834] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.858983] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.859075] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.859252] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.859344] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.859405] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.859545] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.859619] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.859701] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ed604863-9f2b-46cd-939c-7df676073bde is going to be updated. [ 1190.883834] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.884055] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.884055] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.884280] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.884456] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.884621] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ed604863-9f2b-46cd-939c-7df676073bde" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.223793] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3a73f146-1767-411a-a1ec-f992285edea0 in Status: SUCCESS [ 1191.224055] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a73f146-1767-411a-a1ec-f992285edea0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.224204] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a73f146-1767-411a-a1ec-f992285edea0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.224425] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a73f146-1767-411a-a1ec-f992285edea0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.224627] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.224782] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.224852] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.225030] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.225115] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.225201] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a73f146-1767-411a-a1ec-f992285edea0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.225294] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3a73f146-1767-411a-a1ec-f992285edea0',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1191.307374] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1eb9f24d-331e-450b-9da0-82652ecba032 in Status: SUCCESS [ 1191.307625] env[69232]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1eb9f24d-331e-450b-9da0-82652ecba032 deletion is rescheduled due to dependency. [ 1191.307778] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1eb9f24d-331e-450b-9da0-82652ecba032" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.307951] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1eb9f24d-331e-450b-9da0-82652ecba032" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.308277] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1eb9f24d-331e-450b-9da0-82652ecba032" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.308478] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.308600] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.308664] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.309568] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.309568] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.309568] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1eb9f24d-331e-450b-9da0-82652ecba032',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1191.727841] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3a73f146-1767-411a-a1ec-f992285edea0',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1191.813637] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1eb9f24d-331e-450b-9da0-82652ecba032',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1192.229994] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3a73f146-1767-411a-a1ec-f992285edea0: rpc.has_security_group_logging(os_id): False [ 1192.251695] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.251872] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.251917] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.252149] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.252241] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.252477] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.252611] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.252698] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.252859] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.252938] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.253036] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3a73f146-1767-411a-a1ec-f992285edea0 is going to be created. [ 1192.318028] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.318028] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.318028] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.318028] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.318028] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.318324] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1eb9f24d-331e-450b-9da0-82652ecba032',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1192.330188] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3a73f146-1767-411a-a1ec-f992285edea0 in Status: IN_PROGRESS for 2s [ 1192.482379] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 51642e84-0020-4045-91ab-e7c13f6d7a75 in Status: SUCCESS [ 1192.482667] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-51642e84-0020-4045-91ab-e7c13f6d7a75" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.821388] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.821612] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.821612] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.822474] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.822474] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.822474] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1eb9f24d-331e-450b-9da0-82652ecba032 is going to be updated. [ 1192.852217] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.852405] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.852508] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.852808] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.852989] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.856545] env[69232]: INFO networking_nsxv3.common.synchronization [req-07e17791-c5fb-4729-9787-ac779e815018 req-78ce1ec8-fc70-42a7-bdb1-9c5d973fb723 tempest-ServersTestJSON-524901877 tempest-ServersTestJSON-524901877-project-member] Enqueued Resource ID: bdcc7a21-dd0d-4296-ac34-a880ea6123e7 with Priority: HIGHEST for action security_group_members [ 1192.857222] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdcc7a21-dd0d-4296-ac34-a880ea6123e7 with Priority: HIGHEST for action security_group_members [ 1192.858350] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.858350] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.858350] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.858350] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.858350] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.858350] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.858350] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.858350] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.858350] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.858727] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bdcc7a21-dd0d-4296-ac34-a880ea6123e7',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1192.862865] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1eb9f24d-331e-450b-9da0-82652ecba032 in Status: IN_PROGRESS for 2s [ 1193.364298] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bdcc7a21-dd0d-4296-ac34-a880ea6123e7',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.867408] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bdcc7a21-dd0d-4296-ac34-a880ea6123e7',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1194.345517] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3a73f146-1767-411a-a1ec-f992285edea0 in Status: SUCCESS [ 1194.345609] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3a73f146-1767-411a-a1ec-f992285edea0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.370378] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.370831] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.370831] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.370920] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.371029] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.371181] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bdcc7a21-dd0d-4296-ac34-a880ea6123e7 is going to be updated. [ 1194.403214] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.403902] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.403902] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.404089] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.404156] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.415410] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bdcc7a21-dd0d-4296-ac34-a880ea6123e7 in Status: IN_PROGRESS for 2s [ 1194.874519] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1eb9f24d-331e-450b-9da0-82652ecba032 in Status: SUCCESS [ 1194.874790] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1eb9f24d-331e-450b-9da0-82652ecba032" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.874952] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1eb9f24d-331e-450b-9da0-82652ecba032" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.875270] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1eb9f24d-331e-450b-9da0-82652ecba032" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.875515] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.875647] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.875759] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.875944] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.876089] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.876244] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1eb9f24d-331e-450b-9da0-82652ecba032" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.876424] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1eb9f24d-331e-450b-9da0-82652ecba032',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1195.382568] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1eb9f24d-331e-450b-9da0-82652ecba032',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1195.885079] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1eb9f24d-331e-450b-9da0-82652ecba032: rpc.has_security_group_logging(os_id): False [ 1195.903967] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.903967] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.904449] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.904484] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.904631] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.905175] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.905384] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.905384] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.905598] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.905687] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.905797] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1eb9f24d-331e-450b-9da0-82652ecba032 is going to be updated. [ 1195.981376] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.981576] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.981616] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.981851] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.981997] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.998130] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1eb9f24d-331e-450b-9da0-82652ecba032 in Status: IN_PROGRESS for 2s [ 1196.425776] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bdcc7a21-dd0d-4296-ac34-a880ea6123e7 in Status: SUCCESS [ 1196.426149] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.570032] env[69232]: INFO networking_nsxv3.common.synchronization [req-c44fe358-03b8-48d6-a197-9554ba608345 req-259d0e79-afdf-4fc4-a4a3-fd3291015110 tempest-ServerActionsTestOtherA-781098598 tempest-ServerActionsTestOtherA-781098598-project-member] Enqueued Resource ID: 6544a871-f802-46ae-a314-241911fc9dda with Priority: HIGHEST for action security_group_members [ 1196.570528] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6544a871-f802-46ae-a314-241911fc9dda with Priority: HIGHEST for action security_group_members [ 1196.570886] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-6544a871-f802-46ae-a314-241911fc9dda taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.571123] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6544a871-f802-46ae-a314-241911fc9dda" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.571221] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6544a871-f802-46ae-a314-241911fc9dda" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.571505] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6544a871-f802-46ae-a314-241911fc9dda" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.571994] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.571994] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.571994] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.571994] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.572205] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.572205] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6544a871-f802-46ae-a314-241911fc9dda',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1197.076688] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.076688] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.076688] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.076922] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.100858] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.101140] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.101890] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.101890] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.101890] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.101890] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.101890] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6544a871-f802-46ae-a314-241911fc9dda is going to be updated. [ 1197.130747] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.130956] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.130956] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.131176] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.131311] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.141022] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6544a871-f802-46ae-a314-241911fc9dda in Status: IN_PROGRESS for 2s [ 1197.143758] env[69232]: INFO networking_nsxv3.common.synchronization [req-2e5039a6-2a5a-415a-a05a-16f7f9c21f37 req-091d955e-a3a9-4f21-8bff-04c67c2b0749 tempest-ServerMetadataTestJSON-6378904 tempest-ServerMetadataTestJSON-6378904-project-member] Enqueued Resource ID: 51642e84-0020-4045-91ab-e7c13f6d7a75 with Priority: HIGHEST for action security_group_members [ 1197.144604] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 51642e84-0020-4045-91ab-e7c13f6d7a75 with Priority: HIGHEST for action security_group_members [ 1197.147766] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-51642e84-0020-4045-91ab-e7c13f6d7a75 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.147766] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-51642e84-0020-4045-91ab-e7c13f6d7a75" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.147766] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-51642e84-0020-4045-91ab-e7c13f6d7a75" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.147766] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-51642e84-0020-4045-91ab-e7c13f6d7a75" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.147766] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.147766] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.147766] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.147766] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.147766] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.147766] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('51642e84-0020-4045-91ab-e7c13f6d7a75',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1197.650103] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.650439] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.650439] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.650536] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.650636] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.650833] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.650946] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.651021] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.651172] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.651251] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.651350] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 51642e84-0020-4045-91ab-e7c13f6d7a75 is going to be updated. [ 1197.680228] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.680228] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.680228] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.680228] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.680228] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.686886] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 51642e84-0020-4045-91ab-e7c13f6d7a75 in Status: IN_PROGRESS for 2s [ 1198.010072] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1eb9f24d-331e-450b-9da0-82652ecba032 in Status: SUCCESS [ 1198.010293] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1eb9f24d-331e-450b-9da0-82652ecba032" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.150787] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6544a871-f802-46ae-a314-241911fc9dda in Status: SUCCESS [ 1199.151181] env[69232]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6544a871-f802-46ae-a314-241911fc9dda deletion is rescheduled due to dependency. [ 1199.151181] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6544a871-f802-46ae-a314-241911fc9dda" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.507012] env[69232]: INFO networking_nsxv3.common.synchronization [req-d53f2fb2-f658-452c-bdfb-74fe140708f2 req-be08826d-0eff-40bc-a48c-5280108e0e21 tempest-ServersTestJSON-524901877 tempest-ServersTestJSON-524901877-project-member] Enqueued Resource ID: bdcc7a21-dd0d-4296-ac34-a880ea6123e7 with Priority: HIGHEST for action security_group_members [ 1199.507618] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdcc7a21-dd0d-4296-ac34-a880ea6123e7 with Priority: HIGHEST for action security_group_members [ 1199.507746] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.507867] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.507933] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.511236] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.511432] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.511572] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.511631] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.511811] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.511898] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.511994] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bdcc7a21-dd0d-4296-ac34-a880ea6123e7',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1199.698613] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 51642e84-0020-4045-91ab-e7c13f6d7a75 in Status: SUCCESS [ 1199.698807] env[69232]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 51642e84-0020-4045-91ab-e7c13f6d7a75 deletion is rescheduled due to dependency. [ 1199.698923] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-51642e84-0020-4045-91ab-e7c13f6d7a75" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.016044] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.016044] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.016044] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.016044] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.016044] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.016455] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.016455] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.016455] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.016455] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.016598] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.016598] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bdcc7a21-dd0d-4296-ac34-a880ea6123e7 is going to be updated. [ 1200.046528] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.046762] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.046808] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.047091] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.047254] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.060117] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bdcc7a21-dd0d-4296-ac34-a880ea6123e7 in Status: IN_PROGRESS for 2s [ 1202.072681] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bdcc7a21-dd0d-4296-ac34-a880ea6123e7 in Status: SUCCESS [ 1202.073104] env[69232]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bdcc7a21-dd0d-4296-ac34-a880ea6123e7 deletion is rescheduled due to dependency. [ 1202.073293] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.508755] env[69232]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1204.509218] env[69232]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1208.384038] env[69232]: INFO networking_nsxv3.common.synchronization [req-a2acacc2-131b-4594-944e-8b81665a4054 req-a745fc63-835e-464d-baaf-6f723a6004e0 tempest-DeleteServersTestJSON-830271628 tempest-DeleteServersTestJSON-830271628-project-member] Enqueued Resource ID: 9f5186e6-2d35-4ccf-a8b4-749a0a872128 with Priority: HIGHEST for action security_group_members [ 1208.384597] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f5186e6-2d35-4ccf-a8b4-749a0a872128 with Priority: HIGHEST for action security_group_members [ 1208.385105] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f5186e6-2d35-4ccf-a8b4-749a0a872128 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.385105] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.385105] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.385300] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.385453] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.385552] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.385612] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.385756] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.385841] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.385966] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9f5186e6-2d35-4ccf-a8b4-749a0a872128',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1208.758766] env[69232]: INFO networking_nsxv3.common.synchronization [req-b0959166-742e-40d6-ae32-e36202b9c9e1 req-52a92b72-5972-4346-a65c-61452dfce2d2 tempest-ServerActionsTestOtherA-781098598 tempest-ServerActionsTestOtherA-781098598-project-member] Enqueued Resource ID: e18d5d2b-f965-404d-b211-f58621ceccf1 with Priority: HIGHEST for action security_group_members [ 1208.759370] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e18d5d2b-f965-404d-b211-f58621ceccf1 with Priority: HIGHEST for action security_group_members [ 1208.759691] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-e18d5d2b-f965-404d-b211-f58621ceccf1 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.759807] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e18d5d2b-f965-404d-b211-f58621ceccf1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.759893] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e18d5d2b-f965-404d-b211-f58621ceccf1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.760291] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e18d5d2b-f965-404d-b211-f58621ceccf1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.760461] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.760584] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.760685] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.760909] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.761054] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.761200] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e18d5d2b-f965-404d-b211-f58621ceccf1',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1208.889638] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.889929] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.890109] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.890464] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.890821] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.891027] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.891274] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.891274] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.891546] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.891744] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.891894] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9f5186e6-2d35-4ccf-a8b4-749a0a872128 is going to be updated. [ 1208.924705] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.924857] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.924983] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.925218] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.925371] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.934713] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f5186e6-2d35-4ccf-a8b4-749a0a872128 in Status: IN_PROGRESS for 2s [ 1209.196020] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock network-421 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.196020] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "network-421" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.196020] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "network-421" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.196020] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "network-421" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.196020] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.196020] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.196020] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.196919] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.197214] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.197579] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1209.197817] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] NeedRegenerationException {{(pid=69232) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1209.198036] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] no value, waiting for create lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1209.198262] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] value creation lock acquired {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1209.198641] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1209.198871] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Calling creation function for not-yet-present value {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1209.201380] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1209.222023] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1209.222023] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69232) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1209.222023] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Released creation lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1209.222023] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "network-421" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.222023] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock port-017609b2-8eba-46b9-85ac-fd7f36e6f2c1 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.222023] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "port-017609b2-8eba-46b9-85ac-fd7f36e6f2c1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.222023] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "port-017609b2-8eba-46b9-85ac-fd7f36e6f2c1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.222023] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "port-017609b2-8eba-46b9-85ac-fd7f36e6f2c1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.222023] env[69232]: DEBUG networking_nsxv3.api.rpc [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('017609b2-8eba-46b9-85ac-fd7f36e6f2c1',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1209.264430] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.264618] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.264692] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.264952] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.286312] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.286561] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.286781] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.286781] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.286916] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.287009] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.287136] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e18d5d2b-f965-404d-b211-f58621ceccf1 is going to be updated. [ 1209.312591] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.312730] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.312827] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.313115] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.313267] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.322027] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e18d5d2b-f965-404d-b211-f58621ceccf1 in Status: IN_PROGRESS for 2s [ 1209.646038] env[69232]: INFO networking_nsxv3.common.synchronization [req-30876e2e-e151-46f2-a8e0-bd23afe4e915 req-06f478cb-21ce-4cd1-89b9-1ff7e7ac5523 tempest-AttachVolumeNegativeTest-731570695 tempest-AttachVolumeNegativeTest-731570695-project-member] Enqueued Resource ID: 7ee2b034-ee73-4fda-89fe-97d3d457cb9f with Priority: HIGHEST for action security_group_members [ 1209.646633] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ee2b034-ee73-4fda-89fe-97d3d457cb9f with Priority: HIGHEST for action security_group_members [ 1209.646983] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ee2b034-ee73-4fda-89fe-97d3d457cb9f taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.647153] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ee2b034-ee73-4fda-89fe-97d3d457cb9f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.647228] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ee2b034-ee73-4fda-89fe-97d3d457cb9f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.647445] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ee2b034-ee73-4fda-89fe-97d3d457cb9f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.647603] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.647702] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.647764] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.647910] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.647998] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.648107] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7ee2b034-ee73-4fda-89fe-97d3d457cb9f',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1209.725797] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.726132] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.726270] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.726549] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.726711] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.726881] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Segment Port 017609b2-8eba-46b9-85ac-fd7f36e6f2c1 not found, creating... [ 1209.727168] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.727336] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.727474] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.727677] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.727819] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.728118] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.728312] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.728441] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.728653] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.728792] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.728935] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Resource: SegmentPort with ID: 017609b2-8eba-46b9-85ac-fd7f36e6f2c1 is going to be created. [ 1209.750132] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.750523] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.750598] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.750882] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.751137] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.751371] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "port-017609b2-8eba-46b9-85ac-fd7f36e6f2c1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.151073] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.151073] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.151373] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.151373] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.151473] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.151678] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.151796] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.151875] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.152009] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.152084] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.152174] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7ee2b034-ee73-4fda-89fe-97d3d457cb9f is going to be updated. [ 1210.214241] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.214436] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.214436] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.215295] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.215295] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.224436] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7ee2b034-ee73-4fda-89fe-97d3d457cb9f in Status: IN_PROGRESS for 2s [ 1210.446288] env[69232]: INFO networking_nsxv3.common.synchronization [req-b0959166-742e-40d6-ae32-e36202b9c9e1 req-0184d2fd-e90f-4a68-99cf-8a7833e09bce service nova] Enqueued Resource ID: e18d5d2b-f965-404d-b211-f58621ceccf1 with Priority: HIGHEST for action security_group_rules [ 1210.446288] env[69232]: INFO networking_nsxv3.common.synchronization [req-b0959166-742e-40d6-ae32-e36202b9c9e1 req-0184d2fd-e90f-4a68-99cf-8a7833e09bce service nova] Enqueued Resource ID: e18d5d2b-f965-404d-b211-f58621ceccf1 with Priority: HIGHEST for action security_group_members [ 1210.446288] env[69232]: INFO networking_nsxv3.common.synchronization [req-b0959166-742e-40d6-ae32-e36202b9c9e1 req-0184d2fd-e90f-4a68-99cf-8a7833e09bce service nova] Enqueued Resource ID: 017609b2-8eba-46b9-85ac-fd7f36e6f2c1 with Priority: HIGHEST for action port [ 1210.446288] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e18d5d2b-f965-404d-b211-f58621ceccf1 with Priority: HIGHEST for action security_group_rules [ 1210.446288] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e18d5d2b-f965-404d-b211-f58621ceccf1 with Priority: HIGHEST for action security_group_members [ 1210.446288] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 017609b2-8eba-46b9-85ac-fd7f36e6f2c1 with Priority: HIGHEST for action port [ 1210.446288] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e18d5d2b-f965-404d-b211-f58621ceccf1 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.446288] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e18d5d2b-f965-404d-b211-f58621ceccf1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.446288] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e18d5d2b-f965-404d-b211-f58621ceccf1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.446288] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e18d5d2b-f965-404d-b211-f58621ceccf1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.446692] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e18d5d2b-f965-404d-b211-f58621ceccf1',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1210.447756] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-e18d5d2b-f965-404d-b211-f58621ceccf1 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.448000] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e18d5d2b-f965-404d-b211-f58621ceccf1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.448324] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-017609b2-8eba-46b9-85ac-fd7f36e6f2c1 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.448625] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-017609b2-8eba-46b9-85ac-fd7f36e6f2c1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.448855] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-017609b2-8eba-46b9-85ac-fd7f36e6f2c1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.449137] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-017609b2-8eba-46b9-85ac-fd7f36e6f2c1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.449309] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('017609b2-8eba-46b9-85ac-fd7f36e6f2c1',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1210.944536] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f5186e6-2d35-4ccf-a8b4-749a0a872128 in Status: SUCCESS [ 1210.944794] env[69232]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9f5186e6-2d35-4ccf-a8b4-749a0a872128 deletion is rescheduled due to dependency. [ 1210.944835] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.951397] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-e18d5d2b-f965-404d-b211-f58621ceccf1 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.951534] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e18d5d2b-f965-404d-b211-f58621ceccf1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.952876] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 017609b2-8eba-46b9-85ac-fd7f36e6f2c1 with status ACTIVE [ 1210.953082] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.953201] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.953272] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.953470] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.953552] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.953723] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.953818] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.953876] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.954042] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.954125] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.954304] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.954398] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.954474] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.954595] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.954668] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.954749] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 017609b2-8eba-46b9-85ac-fd7f36e6f2c1 is going to be updated. [ 1210.974574] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.974726] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.974769] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.975141] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.975310] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.975491] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-017609b2-8eba-46b9-85ac-fd7f36e6f2c1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.331520] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e18d5d2b-f965-404d-b211-f58621ceccf1 in Status: SUCCESS [ 1211.331709] env[69232]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e18d5d2b-f965-404d-b211-f58621ceccf1 deletion is rescheduled due to dependency. [ 1211.331823] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e18d5d2b-f965-404d-b211-f58621ceccf1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.331977] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e18d5d2b-f965-404d-b211-f58621ceccf1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.332201] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e18d5d2b-f965-404d-b211-f58621ceccf1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.332382] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.332494] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.332560] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.332704] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.332784] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.332878] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e18d5d2b-f965-404d-b211-f58621ceccf1',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1211.834994] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e18d5d2b-f965-404d-b211-f58621ceccf1',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1212.234145] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7ee2b034-ee73-4fda-89fe-97d3d457cb9f in Status: SUCCESS [ 1212.234525] env[69232]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7ee2b034-ee73-4fda-89fe-97d3d457cb9f deletion is rescheduled due to dependency. [ 1212.234525] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ee2b034-ee73-4fda-89fe-97d3d457cb9f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.337064] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e18d5d2b-f965-404d-b211-f58621ceccf1',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1212.839761] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.839761] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.839761] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.839982] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.840093] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.840199] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e18d5d2b-f965-404d-b211-f58621ceccf1 is going to be updated. [ 1212.866742] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.866891] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.866957] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.867219] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.867367] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.877140] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e18d5d2b-f965-404d-b211-f58621ceccf1 in Status: IN_PROGRESS for 2s [ 1214.382261] env[69232]: INFO networking_nsxv3.common.synchronization [None req-22dd2b3f-d762-4a8e-b343-ca1f9707572e tempest-AttachVolumeNegativeTest-731570695 tempest-AttachVolumeNegativeTest-731570695-project-member] Enqueued Resource ID: 88a94cb2-e4db-4ef0-87cd-a3a249cd473f with Priority: HIGHEST for action security_group_rules [ 1214.382818] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88a94cb2-e4db-4ef0-87cd-a3a249cd473f with Priority: HIGHEST for action security_group_rules [ 1214.383197] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-88a94cb2-e4db-4ef0-87cd-a3a249cd473f taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.383325] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-88a94cb2-e4db-4ef0-87cd-a3a249cd473f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.383395] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-88a94cb2-e4db-4ef0-87cd-a3a249cd473f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.383658] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-88a94cb2-e4db-4ef0-87cd-a3a249cd473f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.383887] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('88a94cb2-e4db-4ef0-87cd-a3a249cd473f',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1214.451894] env[69232]: INFO networking_nsxv3.common.synchronization [None req-dd01425a-6f69-4d06-977b-107778d760e4 tempest-AttachVolumeNegativeTest-731570695 tempest-AttachVolumeNegativeTest-731570695-project-member] Enqueued Resource ID: 88a94cb2-e4db-4ef0-87cd-a3a249cd473f with Priority: HIGHEST for action security_group_rules [ 1214.451894] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88a94cb2-e4db-4ef0-87cd-a3a249cd473f with Priority: HIGHEST for action security_group_rules [ 1214.452261] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-88a94cb2-e4db-4ef0-87cd-a3a249cd473f taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.452261] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-88a94cb2-e4db-4ef0-87cd-a3a249cd473f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.889728] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e18d5d2b-f965-404d-b211-f58621ceccf1 in Status: SUCCESS [ 1214.889967] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e18d5d2b-f965-404d-b211-f58621ceccf1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.890153] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e18d5d2b-f965-404d-b211-f58621ceccf1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.890466] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e18d5d2b-f965-404d-b211-f58621ceccf1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.890554] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.890690] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.890744] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.890885] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.890965] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.891059] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e18d5d2b-f965-404d-b211-f58621ceccf1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.891154] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e18d5d2b-f965-404d-b211-f58621ceccf1',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1214.909492] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.909639] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.909711] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.909908] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.910011] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.910172] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 88a94cb2-e4db-4ef0-87cd-a3a249cd473f already deleted. [ 1214.910249] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-88a94cb2-e4db-4ef0-87cd-a3a249cd473f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.910328] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-88a94cb2-e4db-4ef0-87cd-a3a249cd473f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.910481] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-88a94cb2-e4db-4ef0-87cd-a3a249cd473f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.910563] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('88a94cb2-e4db-4ef0-87cd-a3a249cd473f',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1215.393557] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-e18d5d2b-f965-404d-b211-f58621ceccf1 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.393835] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e18d5d2b-f965-404d-b211-f58621ceccf1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.393835] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e18d5d2b-f965-404d-b211-f58621ceccf1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.394025] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e18d5d2b-f965-404d-b211-f58621ceccf1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.394197] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.394299] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.394385] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.394513] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.394597] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.394681] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e18d5d2b-f965-404d-b211-f58621ceccf1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.394822] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-e18d5d2b-f965-404d-b211-f58621ceccf1 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.394911] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e18d5d2b-f965-404d-b211-f58621ceccf1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.394966] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e18d5d2b-f965-404d-b211-f58621ceccf1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.395414] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e18d5d2b-f965-404d-b211-f58621ceccf1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.395414] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.395414] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.395414] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.395582] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.395615] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.395682] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e18d5d2b-f965-404d-b211-f58621ceccf1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.395767] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e18d5d2b-f965-404d-b211-f58621ceccf1',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1215.430912] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.431100] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.431176] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.431425] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.431543] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.431641] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 88a94cb2-e4db-4ef0-87cd-a3a249cd473f already deleted. [ 1215.431719] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-88a94cb2-e4db-4ef0-87cd-a3a249cd473f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.899634] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e18d5d2b-f965-404d-b211-f58621ceccf1: rpc.has_security_group_logging(os_id): False [ 1215.921839] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.921994] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.922570] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.922570] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.922570] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.922842] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.922842] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.922842] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.922994] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.923150] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.923317] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.923404] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.923404] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.923538] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.923610] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.923781] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.924497] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.924497] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.924497] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.924497] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.924497] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e18d5d2b-f965-404d-b211-f58621ceccf1 is going to be updated. [ 1215.987122] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.987417] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.987556] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.987904] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.988183] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.014045] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e18d5d2b-f965-404d-b211-f58621ceccf1 in Status: IN_PROGRESS for 2s [ 1218.030114] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e18d5d2b-f965-404d-b211-f58621ceccf1 in Status: SUCCESS [ 1218.030400] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e18d5d2b-f965-404d-b211-f58621ceccf1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.178997] env[69232]: INFO networking_nsxv3.common.synchronization [None req-c8c55b30-dcb2-459a-af35-e1fb55779212 None None] Enqueued Resource ID: 12b25272-dee9-4a4b-b14f-999ad6cb2539 with Priority: HIGHEST for action port [ 1218.179284] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12b25272-dee9-4a4b-b14f-999ad6cb2539 with Priority: HIGHEST for action port [ 1218.179851] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-12b25272-dee9-4a4b-b14f-999ad6cb2539 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.179976] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-12b25272-dee9-4a4b-b14f-999ad6cb2539" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.180058] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-12b25272-dee9-4a4b-b14f-999ad6cb2539" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.180304] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-12b25272-dee9-4a4b-b14f-999ad6cb2539" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.180385] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('12b25272-dee9-4a4b-b14f-999ad6cb2539',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1218.685542] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 12b25272-dee9-4a4b-b14f-999ad6cb2539 [ 1218.685778] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.685914] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.685984] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.686322] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.686608] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.686704] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:12b25272-dee9-4a4b-b14f-999ad6cb2539 already deleted. [ 1218.686771] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-12b25272-dee9-4a4b-b14f-999ad6cb2539" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.056921] env[69232]: INFO networking_nsxv3.common.synchronization [req-d622547a-45ed-4d70-9abd-c7cabee22803 req-b6f11ce8-796b-451b-a037-39b0c53339f7 tempest-AttachVolumeNegativeTest-731570695 tempest-AttachVolumeNegativeTest-731570695-project-member] Enqueued Resource ID: 88a94cb2-e4db-4ef0-87cd-a3a249cd473f with Priority: HIGHEST for action security_group_members [ 1220.057769] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88a94cb2-e4db-4ef0-87cd-a3a249cd473f with Priority: HIGHEST for action security_group_members [ 1220.058131] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-88a94cb2-e4db-4ef0-87cd-a3a249cd473f taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.058273] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88a94cb2-e4db-4ef0-87cd-a3a249cd473f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.058339] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88a94cb2-e4db-4ef0-87cd-a3a249cd473f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.058655] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88a94cb2-e4db-4ef0-87cd-a3a249cd473f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.058761] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.059301] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.059368] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.059537] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.059748] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.059748] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('88a94cb2-e4db-4ef0-87cd-a3a249cd473f',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1220.205372] env[69232]: INFO networking_nsxv3.common.synchronization [None req-42fec704-ef80-449c-bb3b-23bc4244dc70 None None] Enqueued Resource ID: 78652f65-098e-4d79-a18b-cd117cd0edb0 with Priority: HIGHEST for action port [ 1220.205603] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78652f65-098e-4d79-a18b-cd117cd0edb0 with Priority: HIGHEST for action port [ 1220.206216] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-78652f65-098e-4d79-a18b-cd117cd0edb0 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.206358] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-78652f65-098e-4d79-a18b-cd117cd0edb0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.206405] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-78652f65-098e-4d79-a18b-cd117cd0edb0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.206674] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-78652f65-098e-4d79-a18b-cd117cd0edb0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.206871] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('78652f65-098e-4d79-a18b-cd117cd0edb0',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1220.346254] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock network-55 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.346254] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "network-55" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.346254] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "network-55" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.346254] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "network-55" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.346254] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.346254] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.346534] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.346534] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.346679] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.346905] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1220.347013] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] NeedRegenerationException {{(pid=69232) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1220.347266] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] no value, waiting for create lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1220.347379] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] value creation lock acquired {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1220.347703] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1220.347703] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Calling creation function for not-yet-present value {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1220.348442] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1220.370031] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1220.370221] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69232) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1220.370365] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Released creation lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1220.370542] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "network-55" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.370863] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock port-76ed5c12-af36-49f6-a4cc-af93b8dc0132 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.371051] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "port-76ed5c12-af36-49f6-a4cc-af93b8dc0132" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.371178] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "port-76ed5c12-af36-49f6-a4cc-af93b8dc0132" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.371513] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "port-76ed5c12-af36-49f6-a4cc-af93b8dc0132" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.371654] env[69232]: DEBUG networking_nsxv3.api.rpc [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('76ed5c12-af36-49f6-a4cc-af93b8dc0132',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1220.561547] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.561847] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.561847] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.562016] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.562113] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.562351] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.562453] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.562547] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.562749] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.562832] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.562981] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 88a94cb2-e4db-4ef0-87cd-a3a249cd473f already deleted. [ 1220.563126] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88a94cb2-e4db-4ef0-87cd-a3a249cd473f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.670137] env[69232]: INFO networking_nsxv3.common.synchronization [req-986b2b2b-dc1c-46aa-bcf1-f568b0e85280 req-0e30e75e-57a9-4088-86af-714b77f1d1e5 tempest-AttachVolumeShelveTestJSON-303748050 tempest-AttachVolumeShelveTestJSON-303748050-project-member] Enqueued Resource ID: 5aeb42e6-43fc-4b3e-96b5-dc4a9cddb10c with Priority: HIGHEST for action security_group_members [ 1220.670687] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5aeb42e6-43fc-4b3e-96b5-dc4a9cddb10c with Priority: HIGHEST for action security_group_members [ 1220.671026] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-5aeb42e6-43fc-4b3e-96b5-dc4a9cddb10c taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.671169] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5aeb42e6-43fc-4b3e-96b5-dc4a9cddb10c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.671238] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5aeb42e6-43fc-4b3e-96b5-dc4a9cddb10c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.671436] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5aeb42e6-43fc-4b3e-96b5-dc4a9cddb10c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.671584] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.671682] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.671744] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.671885] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.671968] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.674354] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5aeb42e6-43fc-4b3e-96b5-dc4a9cddb10c',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1220.709103] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 78652f65-098e-4d79-a18b-cd117cd0edb0 [ 1220.709233] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.709302] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.709359] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.710475] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.710475] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.710475] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:78652f65-098e-4d79-a18b-cd117cd0edb0 already deleted. [ 1220.710475] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-78652f65-098e-4d79-a18b-cd117cd0edb0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.711018] env[69232]: INFO networking_nsxv3.common.synchronization [req-b85f3774-4a3c-43a2-bec8-9158bb90712d req-43cec2fb-3b91-4e92-8f0b-823e4e8c1612 tempest-ServerActionsTestOtherA-781098598 tempest-ServerActionsTestOtherA-781098598-project-member] Enqueued Resource ID: e18d5d2b-f965-404d-b211-f58621ceccf1 with Priority: HIGHEST for action security_group_members [ 1220.711935] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e18d5d2b-f965-404d-b211-f58621ceccf1 with Priority: HIGHEST for action security_group_members [ 1220.712249] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-e18d5d2b-f965-404d-b211-f58621ceccf1 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.712353] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e18d5d2b-f965-404d-b211-f58621ceccf1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.712415] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e18d5d2b-f965-404d-b211-f58621ceccf1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.712591] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e18d5d2b-f965-404d-b211-f58621ceccf1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.712741] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.712825] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.712885] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.713039] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.713121] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.713422] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e18d5d2b-f965-404d-b211-f58621ceccf1',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1220.760433] env[69232]: INFO networking_nsxv3.common.synchronization [req-b85f3774-4a3c-43a2-bec8-9158bb90712d req-43cec2fb-3b91-4e92-8f0b-823e4e8c1612 tempest-ServerActionsTestOtherA-781098598 tempest-ServerActionsTestOtherA-781098598-project-member] Enqueued Resource ID: 017609b2-8eba-46b9-85ac-fd7f36e6f2c1 with Priority: HIGHEST for action port [ 1220.760845] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 017609b2-8eba-46b9-85ac-fd7f36e6f2c1 with Priority: HIGHEST for action port [ 1220.761466] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-017609b2-8eba-46b9-85ac-fd7f36e6f2c1 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.761574] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-017609b2-8eba-46b9-85ac-fd7f36e6f2c1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.761706] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-017609b2-8eba-46b9-85ac-fd7f36e6f2c1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.761867] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-017609b2-8eba-46b9-85ac-fd7f36e6f2c1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.761929] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('017609b2-8eba-46b9-85ac-fd7f36e6f2c1',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1220.875200] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.875457] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.875594] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.875888] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.876160] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.876259] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Segment Port 76ed5c12-af36-49f6-a4cc-af93b8dc0132 not found, creating... [ 1220.876500] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.876664] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.876797] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.877127] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.877195] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.877467] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.877630] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.877751] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.877963] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.878236] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.878385] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Resource: SegmentPort with ID: 76ed5c12-af36-49f6-a4cc-af93b8dc0132 is going to be created. [ 1220.898035] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.898227] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.898291] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.898571] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.898808] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.899053] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "port-76ed5c12-af36-49f6-a4cc-af93b8dc0132" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.178642] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.178976] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.178976] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.179313] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.179479] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.179790] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.179963] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.180189] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.180360] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.180507] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.180650] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5aeb42e6-43fc-4b3e-96b5-dc4a9cddb10c is going to be updated. [ 1221.210196] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.210345] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.210415] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.210624] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.210766] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.215542] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.215662] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.215733] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.215935] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.216034] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.216250] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.216348] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.216404] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.216562] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.216637] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.216722] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e18d5d2b-f965-404d-b211-f58621ceccf1 is going to be updated. [ 1221.219973] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5aeb42e6-43fc-4b3e-96b5-dc4a9cddb10c in Status: IN_PROGRESS for 2s [ 1221.243335] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.243486] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.243558] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.243764] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.243902] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.252624] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e18d5d2b-f965-404d-b211-f58621ceccf1 in Status: IN_PROGRESS for 2s [ 1221.264085] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 017609b2-8eba-46b9-85ac-fd7f36e6f2c1 with status ACTIVE [ 1221.264348] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.264495] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.264565] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.264787] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.264876] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.265184] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.265291] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.265291] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.265452] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.265525] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.265745] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.265875] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.265942] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.266109] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.266174] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.266265] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 017609b2-8eba-46b9-85ac-fd7f36e6f2c1 is going to be updated. [ 1221.290033] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.290216] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.290278] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.290479] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.290597] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.290762] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-017609b2-8eba-46b9-85ac-fd7f36e6f2c1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.646073] env[69232]: INFO networking_nsxv3.common.synchronization [req-d622547a-45ed-4d70-9abd-c7cabee22803 req-f2619b67-213e-461c-ac16-931b9b5c3259 service nova] Enqueued Resource ID: 88a94cb2-e4db-4ef0-87cd-a3a249cd473f with Priority: HIGHEST for action security_group_rules [ 1221.646295] env[69232]: INFO networking_nsxv3.common.synchronization [req-d622547a-45ed-4d70-9abd-c7cabee22803 req-f2619b67-213e-461c-ac16-931b9b5c3259 service nova] Enqueued Resource ID: 88a94cb2-e4db-4ef0-87cd-a3a249cd473f with Priority: HIGHEST for action security_group_members [ 1221.646450] env[69232]: INFO networking_nsxv3.common.synchronization [req-d622547a-45ed-4d70-9abd-c7cabee22803 req-f2619b67-213e-461c-ac16-931b9b5c3259 service nova] Enqueued Resource ID: 76ed5c12-af36-49f6-a4cc-af93b8dc0132 with Priority: HIGHEST for action port [ 1221.646945] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88a94cb2-e4db-4ef0-87cd-a3a249cd473f with Priority: HIGHEST for action security_group_rules [ 1221.647125] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88a94cb2-e4db-4ef0-87cd-a3a249cd473f with Priority: HIGHEST for action security_group_members [ 1221.647435] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76ed5c12-af36-49f6-a4cc-af93b8dc0132 with Priority: HIGHEST for action port [ 1221.647435] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-88a94cb2-e4db-4ef0-87cd-a3a249cd473f taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.647570] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-88a94cb2-e4db-4ef0-87cd-a3a249cd473f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.647610] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-88a94cb2-e4db-4ef0-87cd-a3a249cd473f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.647936] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-88a94cb2-e4db-4ef0-87cd-a3a249cd473f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.647936] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('88a94cb2-e4db-4ef0-87cd-a3a249cd473f',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1221.648843] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-88a94cb2-e4db-4ef0-87cd-a3a249cd473f taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.650254] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88a94cb2-e4db-4ef0-87cd-a3a249cd473f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.650254] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88a94cb2-e4db-4ef0-87cd-a3a249cd473f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.650254] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88a94cb2-e4db-4ef0-87cd-a3a249cd473f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.650254] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.650254] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.650254] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.650254] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.650254] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.650254] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('88a94cb2-e4db-4ef0-87cd-a3a249cd473f',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1221.650716] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-76ed5c12-af36-49f6-a4cc-af93b8dc0132 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.650716] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-76ed5c12-af36-49f6-a4cc-af93b8dc0132" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.650716] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-76ed5c12-af36-49f6-a4cc-af93b8dc0132" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.650875] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-76ed5c12-af36-49f6-a4cc-af93b8dc0132" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.650875] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('76ed5c12-af36-49f6-a4cc-af93b8dc0132',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1222.153065] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('88a94cb2-e4db-4ef0-87cd-a3a249cd473f',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1222.154032] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-88a94cb2-e4db-4ef0-87cd-a3a249cd473f taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.154032] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88a94cb2-e4db-4ef0-87cd-a3a249cd473f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.154032] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 76ed5c12-af36-49f6-a4cc-af93b8dc0132 with status ACTIVE [ 1222.154272] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.154272] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.154359] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.154504] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.154606] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.156144] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.156144] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.156144] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.156144] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.156144] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.156144] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.156144] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.156144] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.156144] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.156144] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.156144] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 76ed5c12-af36-49f6-a4cc-af93b8dc0132 is going to be updated. [ 1222.203978] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.203978] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.203978] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.203978] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.204332] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.204332] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-76ed5c12-af36-49f6-a4cc-af93b8dc0132" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.659252] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('88a94cb2-e4db-4ef0-87cd-a3a249cd473f',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1223.163987] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.164177] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.164341] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.164451] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.164542] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.164640] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 88a94cb2-e4db-4ef0-87cd-a3a249cd473f is going to be created. [ 1223.197977] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.198137] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.198207] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.198417] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.198572] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.212096] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88a94cb2-e4db-4ef0-87cd-a3a249cd473f in Status: UNINITIALIZED for 2s [ 1223.230579] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5aeb42e6-43fc-4b3e-96b5-dc4a9cddb10c in Status: SUCCESS [ 1223.232149] env[69232]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5aeb42e6-43fc-4b3e-96b5-dc4a9cddb10c deletion is rescheduled due to dependency. [ 1223.232486] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5aeb42e6-43fc-4b3e-96b5-dc4a9cddb10c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.262404] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e18d5d2b-f965-404d-b211-f58621ceccf1 in Status: SUCCESS [ 1223.262646] env[69232]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e18d5d2b-f965-404d-b211-f58621ceccf1 deletion is rescheduled due to dependency. [ 1223.262646] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e18d5d2b-f965-404d-b211-f58621ceccf1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.672206] env[69232]: INFO networking_nsxv3.common.synchronization [req-670fbfa6-0be7-4c00-bc62-78340eb39c5d req-45225e14-bb42-45a8-972c-914237700fc5 tempest-ServerAddressesTestJSON-1082859933 tempest-ServerAddressesTestJSON-1082859933-project-member] Enqueued Resource ID: 461f1cb8-c9f3-4683-9685-9c2437ba8d4d with Priority: HIGHEST for action security_group_members [ 1224.672998] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 461f1cb8-c9f3-4683-9685-9c2437ba8d4d with Priority: HIGHEST for action security_group_members [ 1224.673512] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-461f1cb8-c9f3-4683-9685-9c2437ba8d4d taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.673682] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-461f1cb8-c9f3-4683-9685-9c2437ba8d4d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.673787] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-461f1cb8-c9f3-4683-9685-9c2437ba8d4d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.674107] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-461f1cb8-c9f3-4683-9685-9c2437ba8d4d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.674297] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.674404] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.674685] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.674923] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.675031] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.675159] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('461f1cb8-c9f3-4683-9685-9c2437ba8d4d',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1224.984385] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock network-178 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.984598] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "network-178" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.984730] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "network-178" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.985173] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "network-178" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.985458] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.985629] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.985750] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.985987] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.986195] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.986428] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1224.986566] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] NeedRegenerationException {{(pid=69232) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1224.986682] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] no value, waiting for create lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1224.986797] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] value creation lock acquired {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1224.986913] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1224.987034] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Calling creation function for not-yet-present value {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1224.987201] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1225.008359] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1225.008701] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69232) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1225.008847] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Released creation lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1225.008971] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "network-178" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.009305] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock port-85c6cfbc-cf0b-4865-8dbf-b4c69e77a7ea taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.009481] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "port-85c6cfbc-cf0b-4865-8dbf-b4c69e77a7ea" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.009614] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "port-85c6cfbc-cf0b-4865-8dbf-b4c69e77a7ea" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.009990] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "port-85c6cfbc-cf0b-4865-8dbf-b4c69e77a7ea" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.010827] env[69232]: DEBUG networking_nsxv3.api.rpc [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('85c6cfbc-cf0b-4865-8dbf-b4c69e77a7ea',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1225.177203] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.177425] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.177425] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.177761] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.177855] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.178173] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.178317] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.178317] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.178511] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.178619] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.178752] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 461f1cb8-c9f3-4683-9685-9c2437ba8d4d already deleted. [ 1225.178835] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-461f1cb8-c9f3-4683-9685-9c2437ba8d4d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.222632] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88a94cb2-e4db-4ef0-87cd-a3a249cd473f in Status: SUCCESS [ 1225.222805] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88a94cb2-e4db-4ef0-87cd-a3a249cd473f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.223095] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88a94cb2-e4db-4ef0-87cd-a3a249cd473f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.223376] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88a94cb2-e4db-4ef0-87cd-a3a249cd473f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.223633] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.223764] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.223822] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.223984] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.224085] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.224186] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88a94cb2-e4db-4ef0-87cd-a3a249cd473f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.224321] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('88a94cb2-e4db-4ef0-87cd-a3a249cd473f',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1225.513523] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.513825] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.513912] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.514259] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.514428] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.514592] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Segment Port 85c6cfbc-cf0b-4865-8dbf-b4c69e77a7ea not found, creating... [ 1225.514871] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.515043] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.515212] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.515478] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.515646] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.516037] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.516229] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.516356] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.516579] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.516717] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.516862] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Resource: SegmentPort with ID: 85c6cfbc-cf0b-4865-8dbf-b4c69e77a7ea is going to be created. [ 1225.537663] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.538018] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.538254] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.538634] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.538961] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.539282] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "port-85c6cfbc-cf0b-4865-8dbf-b4c69e77a7ea" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.727146] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('88a94cb2-e4db-4ef0-87cd-a3a249cd473f',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1226.229997] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 88a94cb2-e4db-4ef0-87cd-a3a249cd473f: rpc.has_security_group_logging(os_id): False [ 1226.249703] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.249781] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.249820] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.250050] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.250140] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.250375] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.250480] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.250544] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.250691] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.250768] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.250853] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 88a94cb2-e4db-4ef0-87cd-a3a249cd473f is going to be created. [ 1226.397354] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.397519] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.397586] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.397814] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.397996] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.409380] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 88a94cb2-e4db-4ef0-87cd-a3a249cd473f in Status: IN_PROGRESS for 2s [ 1226.471831] env[69232]: INFO networking_nsxv3.common.synchronization [req-670fbfa6-0be7-4c00-bc62-78340eb39c5d req-74e3c052-bd66-4455-8d92-ede78c752a44 service nova] Enqueued Resource ID: 461f1cb8-c9f3-4683-9685-9c2437ba8d4d with Priority: HIGHEST for action security_group_rules [ 1226.471995] env[69232]: INFO networking_nsxv3.common.synchronization [req-670fbfa6-0be7-4c00-bc62-78340eb39c5d req-74e3c052-bd66-4455-8d92-ede78c752a44 service nova] Enqueued Resource ID: 461f1cb8-c9f3-4683-9685-9c2437ba8d4d with Priority: HIGHEST for action security_group_members [ 1226.472161] env[69232]: INFO networking_nsxv3.common.synchronization [req-670fbfa6-0be7-4c00-bc62-78340eb39c5d req-74e3c052-bd66-4455-8d92-ede78c752a44 service nova] Enqueued Resource ID: 85c6cfbc-cf0b-4865-8dbf-b4c69e77a7ea with Priority: HIGHEST for action port [ 1226.472678] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 461f1cb8-c9f3-4683-9685-9c2437ba8d4d with Priority: HIGHEST for action security_group_rules [ 1226.472885] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 461f1cb8-c9f3-4683-9685-9c2437ba8d4d with Priority: HIGHEST for action security_group_members [ 1226.472995] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85c6cfbc-cf0b-4865-8dbf-b4c69e77a7ea with Priority: HIGHEST for action port [ 1226.473265] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-461f1cb8-c9f3-4683-9685-9c2437ba8d4d taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.473393] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-461f1cb8-c9f3-4683-9685-9c2437ba8d4d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.473603] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-461f1cb8-c9f3-4683-9685-9c2437ba8d4d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.473707] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-461f1cb8-c9f3-4683-9685-9c2437ba8d4d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.473794] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('461f1cb8-c9f3-4683-9685-9c2437ba8d4d',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1226.474700] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-461f1cb8-c9f3-4683-9685-9c2437ba8d4d taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.474777] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-461f1cb8-c9f3-4683-9685-9c2437ba8d4d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.474836] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-461f1cb8-c9f3-4683-9685-9c2437ba8d4d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.475013] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-461f1cb8-c9f3-4683-9685-9c2437ba8d4d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.475243] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.475392] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.475471] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.475614] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.475701] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.475799] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('461f1cb8-c9f3-4683-9685-9c2437ba8d4d',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1226.476762] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-85c6cfbc-cf0b-4865-8dbf-b4c69e77a7ea taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.476873] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-85c6cfbc-cf0b-4865-8dbf-b4c69e77a7ea" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.476873] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-85c6cfbc-cf0b-4865-8dbf-b4c69e77a7ea" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.477031] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-85c6cfbc-cf0b-4865-8dbf-b4c69e77a7ea" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.477111] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('85c6cfbc-cf0b-4865-8dbf-b4c69e77a7ea',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1226.980549] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-461f1cb8-c9f3-4683-9685-9c2437ba8d4d taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.981025] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-461f1cb8-c9f3-4683-9685-9c2437ba8d4d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.981187] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('461f1cb8-c9f3-4683-9685-9c2437ba8d4d',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1226.982015] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 85c6cfbc-cf0b-4865-8dbf-b4c69e77a7ea with status ACTIVE [ 1226.982199] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.982340] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.982414] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.982605] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.982706] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.982891] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.982996] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.983082] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.983234] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.983309] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.983482] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.983569] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.983636] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.983765] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.983836] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.983916] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 85c6cfbc-cf0b-4865-8dbf-b4c69e77a7ea is going to be updated. [ 1227.009618] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.009800] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.009858] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.010078] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.010216] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.010375] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-85c6cfbc-cf0b-4865-8dbf-b4c69e77a7ea" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.491079] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('461f1cb8-c9f3-4683-9685-9c2437ba8d4d',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1227.993638] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.993871] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.993871] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.994118] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.994213] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.994345] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 461f1cb8-c9f3-4683-9685-9c2437ba8d4d is going to be created. [ 1228.017853] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.018055] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.018120] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.018336] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.018539] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.031277] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 461f1cb8-c9f3-4683-9685-9c2437ba8d4d in Status: UNINITIALIZED for 2s [ 1228.421984] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 88a94cb2-e4db-4ef0-87cd-a3a249cd473f in Status: SUCCESS [ 1228.422335] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-88a94cb2-e4db-4ef0-87cd-a3a249cd473f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.044064] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 461f1cb8-c9f3-4683-9685-9c2437ba8d4d in Status: SUCCESS [ 1230.044464] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-461f1cb8-c9f3-4683-9685-9c2437ba8d4d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.044588] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-461f1cb8-c9f3-4683-9685-9c2437ba8d4d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.044857] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-461f1cb8-c9f3-4683-9685-9c2437ba8d4d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.045106] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.045257] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.045344] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.045501] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.045583] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.045670] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-461f1cb8-c9f3-4683-9685-9c2437ba8d4d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.045760] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('461f1cb8-c9f3-4683-9685-9c2437ba8d4d',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1230.548179] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-461f1cb8-c9f3-4683-9685-9c2437ba8d4d taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.548344] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-461f1cb8-c9f3-4683-9685-9c2437ba8d4d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.548344] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-461f1cb8-c9f3-4683-9685-9c2437ba8d4d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.548515] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-461f1cb8-c9f3-4683-9685-9c2437ba8d4d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.548675] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.548789] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.548852] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.549016] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.549482] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.549482] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-461f1cb8-c9f3-4683-9685-9c2437ba8d4d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.549482] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-461f1cb8-c9f3-4683-9685-9c2437ba8d4d taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.549482] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-461f1cb8-c9f3-4683-9685-9c2437ba8d4d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.549754] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-461f1cb8-c9f3-4683-9685-9c2437ba8d4d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.549754] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-461f1cb8-c9f3-4683-9685-9c2437ba8d4d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.549822] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.549917] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.549983] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.550301] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.550390] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.550494] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-461f1cb8-c9f3-4683-9685-9c2437ba8d4d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.550587] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('461f1cb8-c9f3-4683-9685-9c2437ba8d4d',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1231.052906] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 461f1cb8-c9f3-4683-9685-9c2437ba8d4d: rpc.has_security_group_logging(os_id): False [ 1231.076082] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.076347] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.076347] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.076543] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.076631] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.076859] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.076967] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.077040] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.077219] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.077313] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.077531] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.077665] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.077665] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.077766] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.077836] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.078068] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.078178] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.078244] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.078388] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.078462] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.078577] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 461f1cb8-c9f3-4683-9685-9c2437ba8d4d is going to be created. [ 1231.168310] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.168507] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.168617] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.168850] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.169064] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.182933] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 461f1cb8-c9f3-4683-9685-9c2437ba8d4d in Status: IN_PROGRESS for 2s [ 1231.473822] env[69232]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1231.473974] env[69232]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1233.195365] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 461f1cb8-c9f3-4683-9685-9c2437ba8d4d in Status: SUCCESS [ 1233.195759] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-461f1cb8-c9f3-4683-9685-9c2437ba8d4d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.475115] env[69232]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1236.475569] env[69232]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1237.788552] env[69232]: INFO networking_nsxv3.common.synchronization [req-d14c5199-1624-4744-b919-7e654a1e3e84 req-62d363dc-a5e2-40c5-8f55-2ceecd8e2a87 tempest-ServerAddressesTestJSON-1082859933 tempest-ServerAddressesTestJSON-1082859933-project-member] Enqueued Resource ID: 461f1cb8-c9f3-4683-9685-9c2437ba8d4d with Priority: HIGHEST for action security_group_members [ 1237.789363] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 461f1cb8-c9f3-4683-9685-9c2437ba8d4d with Priority: HIGHEST for action security_group_members [ 1237.789827] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-461f1cb8-c9f3-4683-9685-9c2437ba8d4d taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.789925] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-461f1cb8-c9f3-4683-9685-9c2437ba8d4d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.789985] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-461f1cb8-c9f3-4683-9685-9c2437ba8d4d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.790239] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-461f1cb8-c9f3-4683-9685-9c2437ba8d4d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.794025] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.794025] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.794025] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.794025] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.794025] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.794025] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('461f1cb8-c9f3-4683-9685-9c2437ba8d4d',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1238.295145] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.295145] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.295145] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.295522] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.295522] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.295597] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.295694] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.295754] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.295911] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.295989] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.296086] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 461f1cb8-c9f3-4683-9685-9c2437ba8d4d is going to be updated. [ 1238.336178] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.336338] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.336440] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.336651] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.336795] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.344962] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 461f1cb8-c9f3-4683-9685-9c2437ba8d4d in Status: IN_PROGRESS for 2s [ 1240.356199] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 461f1cb8-c9f3-4683-9685-9c2437ba8d4d in Status: SUCCESS [ 1240.356624] env[69232]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 461f1cb8-c9f3-4683-9685-9c2437ba8d4d deletion is rescheduled due to dependency. [ 1240.356624] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-461f1cb8-c9f3-4683-9685-9c2437ba8d4d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.790604] env[69232]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1242.790959] env[69232]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1246.864140] env[69232]: INFO networking_nsxv3.common.synchronization [None req-5db645a8-7bfd-46b3-888e-5d6930f77458 None None] Enqueued Resource ID: 3c4053e1-2cec-44a4-82cc-370050e76ae1 with Priority: HIGHEST for action port [ 1246.864622] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c4053e1-2cec-44a4-82cc-370050e76ae1 with Priority: HIGHEST for action port [ 1246.864954] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-3c4053e1-2cec-44a4-82cc-370050e76ae1 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.866228] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3c4053e1-2cec-44a4-82cc-370050e76ae1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.867100] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3c4053e1-2cec-44a4-82cc-370050e76ae1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.867100] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3c4053e1-2cec-44a4-82cc-370050e76ae1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.867250] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3c4053e1-2cec-44a4-82cc-370050e76ae1',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1247.368890] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3c4053e1-2cec-44a4-82cc-370050e76ae1 [ 1247.371486] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.371486] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.371486] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.371486] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.371486] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.371486] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3c4053e1-2cec-44a4-82cc-370050e76ae1 already deleted. [ 1247.371486] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3c4053e1-2cec-44a4-82cc-370050e76ae1" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.868514] env[69232]: INFO networking_nsxv3.common.synchronization [req-585270aa-2773-4e4f-a65a-f8c325ed82c3 req-cf7fdee4-9281-4b47-a7bb-025fe748a9e7 tempest-ServerActionsTestOtherA-781098598 tempest-ServerActionsTestOtherA-781098598-project-member] Enqueued Resource ID: 3e5e65a3-941b-4419-9265-0dce9e80179e with Priority: HIGHEST for action security_group_members [ 1248.869101] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e5e65a3-941b-4419-9265-0dce9e80179e with Priority: HIGHEST for action security_group_members [ 1248.869425] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e5e65a3-941b-4419-9265-0dce9e80179e taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.869555] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e5e65a3-941b-4419-9265-0dce9e80179e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.869626] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e5e65a3-941b-4419-9265-0dce9e80179e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.869828] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e5e65a3-941b-4419-9265-0dce9e80179e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.869980] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.870133] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.870198] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.870347] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.870436] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.870530] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3e5e65a3-941b-4419-9265-0dce9e80179e',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1249.191077] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock network-421 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.191077] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "network-421" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.191077] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "network-421" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.191484] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "network-421" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.191484] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.191613] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.191731] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.191949] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.192113] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.192329] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1249.192447] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] NeedRegenerationException {{(pid=69232) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1249.192573] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] no value, waiting for create lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1249.192735] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] value creation lock acquired {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1249.192846] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1249.192962] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Calling creation function for not-yet-present value {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1249.193113] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1249.214164] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1249.214370] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69232) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1249.214515] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Released creation lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1249.214792] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "network-421" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.215129] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock port-e9211223-3f26-4a98-9b39-513093d41903 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.215312] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "port-e9211223-3f26-4a98-9b39-513093d41903" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.215583] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "port-e9211223-3f26-4a98-9b39-513093d41903" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.215983] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "port-e9211223-3f26-4a98-9b39-513093d41903" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.216159] env[69232]: DEBUG networking_nsxv3.api.rpc [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e9211223-3f26-4a98-9b39-513093d41903',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1249.372534] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3e5e65a3-941b-4419-9265-0dce9e80179e',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1249.718833] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.718833] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.718833] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.719126] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.719210] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.719372] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Segment Port e9211223-3f26-4a98-9b39-513093d41903 not found, creating... [ 1249.719767] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.719955] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.720108] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.720351] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.720490] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.720799] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.720961] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.721101] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.721425] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.721572] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.721721] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Resource: SegmentPort with ID: e9211223-3f26-4a98-9b39-513093d41903 is going to be created. [ 1249.745027] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.745274] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.745447] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.745771] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.746022] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.746266] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "port-e9211223-3f26-4a98-9b39-513093d41903" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.875373] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3e5e65a3-941b-4419-9265-0dce9e80179e',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1250.379621] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.379621] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.379621] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.379621] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.379621] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.379621] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3e5e65a3-941b-4419-9265-0dce9e80179e is going to be updated. [ 1250.420893] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.421200] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.421272] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.422463] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.422463] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.431210] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e5e65a3-941b-4419-9265-0dce9e80179e in Status: IN_PROGRESS for 2s [ 1250.439957] env[69232]: INFO networking_nsxv3.common.synchronization [req-585270aa-2773-4e4f-a65a-f8c325ed82c3 req-1325c958-9a96-425a-a81f-6edab41de0d9 service nova] Enqueued Resource ID: 3e5e65a3-941b-4419-9265-0dce9e80179e with Priority: HIGHEST for action security_group_rules [ 1250.439957] env[69232]: INFO networking_nsxv3.common.synchronization [req-585270aa-2773-4e4f-a65a-f8c325ed82c3 req-1325c958-9a96-425a-a81f-6edab41de0d9 service nova] Enqueued Resource ID: 3e5e65a3-941b-4419-9265-0dce9e80179e with Priority: HIGHEST for action security_group_members [ 1250.439957] env[69232]: INFO networking_nsxv3.common.synchronization [req-585270aa-2773-4e4f-a65a-f8c325ed82c3 req-1325c958-9a96-425a-a81f-6edab41de0d9 service nova] Enqueued Resource ID: e9211223-3f26-4a98-9b39-513093d41903 with Priority: HIGHEST for action port [ 1250.439957] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e5e65a3-941b-4419-9265-0dce9e80179e with Priority: HIGHEST for action security_group_rules [ 1250.439957] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e5e65a3-941b-4419-9265-0dce9e80179e with Priority: HIGHEST for action security_group_members [ 1250.439957] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9211223-3f26-4a98-9b39-513093d41903 with Priority: HIGHEST for action port [ 1250.439957] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3e5e65a3-941b-4419-9265-0dce9e80179e taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.439957] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3e5e65a3-941b-4419-9265-0dce9e80179e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.439957] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3e5e65a3-941b-4419-9265-0dce9e80179e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.440611] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3e5e65a3-941b-4419-9265-0dce9e80179e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.440799] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3e5e65a3-941b-4419-9265-0dce9e80179e',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1250.443141] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e5e65a3-941b-4419-9265-0dce9e80179e taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.443394] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e5e65a3-941b-4419-9265-0dce9e80179e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.443714] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-e9211223-3f26-4a98-9b39-513093d41903 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.443975] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e9211223-3f26-4a98-9b39-513093d41903" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.444158] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e9211223-3f26-4a98-9b39-513093d41903" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.444432] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e9211223-3f26-4a98-9b39-513093d41903" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.444615] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e9211223-3f26-4a98-9b39-513093d41903',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1250.948165] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e5e65a3-941b-4419-9265-0dce9e80179e taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.948464] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e5e65a3-941b-4419-9265-0dce9e80179e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.948512] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e9211223-3f26-4a98-9b39-513093d41903 with status ACTIVE [ 1250.948694] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.948803] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.948869] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.949098] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.949193] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.949377] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.949478] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.949545] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.949701] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.949813] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.949960] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.950067] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.950126] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.950271] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.950370] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.950481] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e9211223-3f26-4a98-9b39-513093d41903 is going to be updated. [ 1250.970838] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.971049] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.971049] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.971240] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.971372] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.971526] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e9211223-3f26-4a98-9b39-513093d41903" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.441207] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e5e65a3-941b-4419-9265-0dce9e80179e in Status: SUCCESS [ 1252.441550] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e5e65a3-941b-4419-9265-0dce9e80179e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.441614] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e5e65a3-941b-4419-9265-0dce9e80179e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.441828] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e5e65a3-941b-4419-9265-0dce9e80179e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.442058] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.442196] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.442280] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.442474] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.442586] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.442698] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3e5e65a3-941b-4419-9265-0dce9e80179e',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1252.945830] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3e5e65a3-941b-4419-9265-0dce9e80179e',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1253.447658] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3e5e65a3-941b-4419-9265-0dce9e80179e',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1253.950800] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.951076] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.951076] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.951234] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.951333] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.951438] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3e5e65a3-941b-4419-9265-0dce9e80179e is going to be updated. [ 1253.979992] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.980219] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.980219] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.980445] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.980600] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.990398] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e5e65a3-941b-4419-9265-0dce9e80179e in Status: IN_PROGRESS for 2s [ 1255.440368] env[69232]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1255.440368] env[69232]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1256.001653] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e5e65a3-941b-4419-9265-0dce9e80179e in Status: SUCCESS [ 1256.002106] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e5e65a3-941b-4419-9265-0dce9e80179e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.002270] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e5e65a3-941b-4419-9265-0dce9e80179e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.002519] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e5e65a3-941b-4419-9265-0dce9e80179e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.002776] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.002921] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.003030] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.003245] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.003373] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.003503] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e5e65a3-941b-4419-9265-0dce9e80179e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.003623] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3e5e65a3-941b-4419-9265-0dce9e80179e',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1256.506609] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3e5e65a3-941b-4419-9265-0dce9e80179e',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1257.008831] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3e5e65a3-941b-4419-9265-0dce9e80179e: rpc.has_security_group_logging(os_id): False [ 1257.026420] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.026657] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.026657] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.026903] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.044462] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.044750] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.044869] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.044926] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.045139] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.045221] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.045313] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3e5e65a3-941b-4419-9265-0dce9e80179e is going to be updated. [ 1257.105638] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.105881] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.105881] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.106327] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.106446] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.119822] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3e5e65a3-941b-4419-9265-0dce9e80179e in Status: IN_PROGRESS for 2s [ 1259.135271] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3e5e65a3-941b-4419-9265-0dce9e80179e in Status: SUCCESS [ 1259.135686] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3e5e65a3-941b-4419-9265-0dce9e80179e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.311944] env[69232]: INFO networking_nsxv3.common.synchronization [req-4ad67a88-ba1c-4073-b994-54c939981585 req-b97ca984-eb4c-472d-8922-030b8b231e3e tempest-ServerActionsTestOtherB-650813181 tempest-ServerActionsTestOtherB-650813181-project-member] Enqueued Resource ID: 934b2684-b99c-4846-87df-66cbae10f2fc with Priority: HIGHEST for action security_group_members [ 1260.312505] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 934b2684-b99c-4846-87df-66cbae10f2fc with Priority: HIGHEST for action security_group_members [ 1260.312718] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-934b2684-b99c-4846-87df-66cbae10f2fc taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.312868] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-934b2684-b99c-4846-87df-66cbae10f2fc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.312940] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-934b2684-b99c-4846-87df-66cbae10f2fc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.314158] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-934b2684-b99c-4846-87df-66cbae10f2fc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.314335] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.314442] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.314505] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.314675] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.314759] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.314888] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('934b2684-b99c-4846-87df-66cbae10f2fc',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1260.818240] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.818453] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.818507] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.818761] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.818882] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.819121] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.819223] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.819270] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.819413] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.819488] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.819574] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 934b2684-b99c-4846-87df-66cbae10f2fc is going to be updated. [ 1260.844875] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.845067] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.845124] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.845307] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.845446] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.854343] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 934b2684-b99c-4846-87df-66cbae10f2fc in Status: IN_PROGRESS for 2s [ 1262.866300] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 934b2684-b99c-4846-87df-66cbae10f2fc in Status: SUCCESS [ 1262.866699] env[69232]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 934b2684-b99c-4846-87df-66cbae10f2fc deletion is rescheduled due to dependency. [ 1262.866699] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-934b2684-b99c-4846-87df-66cbae10f2fc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.313647] env[69232]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1265.313939] env[69232]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1270.152440] env[69232]: INFO networking_nsxv3.common.synchronization [req-b8fd51d5-d6ff-431e-981e-dc703424eb0a req-9e33b081-191d-4b90-b321-d8f94d1b106a tempest-ServerActionsTestOtherB-650813181 tempest-ServerActionsTestOtherB-650813181-project-member] Enqueued Resource ID: 934b2684-b99c-4846-87df-66cbae10f2fc with Priority: HIGHEST for action security_group_members [ 1270.152768] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 934b2684-b99c-4846-87df-66cbae10f2fc with Priority: HIGHEST for action security_group_members [ 1270.153071] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-934b2684-b99c-4846-87df-66cbae10f2fc taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.153231] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-934b2684-b99c-4846-87df-66cbae10f2fc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.153303] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-934b2684-b99c-4846-87df-66cbae10f2fc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.153504] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-934b2684-b99c-4846-87df-66cbae10f2fc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.153700] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.153810] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.153874] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.154038] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.154130] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.154214] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('934b2684-b99c-4846-87df-66cbae10f2fc',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.489537] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock network-424 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.489771] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "network-424" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.489882] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "network-424" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.490194] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "network-424" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.490461] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.490625] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.490750] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.490981] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.491144] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.491364] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1270.491521] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] NeedRegenerationException {{(pid=69232) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1270.491601] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] no value, waiting for create lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1270.491709] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] value creation lock acquired {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1270.491825] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1270.491937] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Calling creation function for not-yet-present value {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1270.492088] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1270.512400] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1270.512964] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69232) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1270.512964] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Released creation lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1270.513162] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "network-424" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.513475] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock port-23815fb9-fdde-47d3-94ea-51a989be962c taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.513749] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "port-23815fb9-fdde-47d3-94ea-51a989be962c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.513873] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "port-23815fb9-fdde-47d3-94ea-51a989be962c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.514304] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "port-23815fb9-fdde-47d3-94ea-51a989be962c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.514395] env[69232]: DEBUG networking_nsxv3.api.rpc [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('23815fb9-fdde-47d3-94ea-51a989be962c',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.640141] env[69232]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-94066da2-e1f6-4276-9635-375c603f4834 None None] NSXv3 Agent Agent loop - iteration:2 completed [ 1270.640312] env[69232]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-94066da2-e1f6-4276-9635-375c603f4834 None None] NSXv3 Agent Agent loop - iteration:3 started [ 1270.657015] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.657193] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.657247] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.657425] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.657518] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.657702] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.657798] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.657858] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.658015] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.658095] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.658182] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 934b2684-b99c-4846-87df-66cbae10f2fc is going to be updated. [ 1270.687546] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.687701] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.687769] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.688014] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.688160] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.697295] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 934b2684-b99c-4846-87df-66cbae10f2fc in Status: IN_PROGRESS for 2s [ 1271.017068] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.017273] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.017383] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.017669] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.017828] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.018020] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Segment Port 23815fb9-fdde-47d3-94ea-51a989be962c not found, creating... [ 1271.018332] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.018496] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.018620] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.018861] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.019016] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.019313] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.019471] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.019594] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.019816] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.020015] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.020128] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Resource: SegmentPort with ID: 23815fb9-fdde-47d3-94ea-51a989be962c is going to be created. [ 1271.040061] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.040293] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.040425] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.040690] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.040924] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.041181] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "port-23815fb9-fdde-47d3-94ea-51a989be962c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.815968] env[69232]: INFO networking_nsxv3.common.synchronization [req-b8fd51d5-d6ff-431e-981e-dc703424eb0a req-f0800c84-746f-4e54-a728-dffc493ba443 service nova] Enqueued Resource ID: 934b2684-b99c-4846-87df-66cbae10f2fc with Priority: HIGHEST for action security_group_rules [ 1271.816350] env[69232]: INFO networking_nsxv3.common.synchronization [req-b8fd51d5-d6ff-431e-981e-dc703424eb0a req-f0800c84-746f-4e54-a728-dffc493ba443 service nova] Enqueued Resource ID: 934b2684-b99c-4846-87df-66cbae10f2fc with Priority: HIGHEST for action security_group_members [ 1271.816350] env[69232]: INFO networking_nsxv3.common.synchronization [req-b8fd51d5-d6ff-431e-981e-dc703424eb0a req-f0800c84-746f-4e54-a728-dffc493ba443 service nova] Enqueued Resource ID: 23815fb9-fdde-47d3-94ea-51a989be962c with Priority: HIGHEST for action port [ 1271.816910] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 934b2684-b99c-4846-87df-66cbae10f2fc with Priority: HIGHEST for action security_group_rules [ 1271.817352] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 934b2684-b99c-4846-87df-66cbae10f2fc with Priority: HIGHEST for action security_group_members [ 1271.817517] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23815fb9-fdde-47d3-94ea-51a989be962c with Priority: HIGHEST for action port [ 1271.817857] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-934b2684-b99c-4846-87df-66cbae10f2fc taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.818092] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-934b2684-b99c-4846-87df-66cbae10f2fc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.818201] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-934b2684-b99c-4846-87df-66cbae10f2fc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.818429] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-934b2684-b99c-4846-87df-66cbae10f2fc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.818566] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('934b2684-b99c-4846-87df-66cbae10f2fc',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1271.820277] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-934b2684-b99c-4846-87df-66cbae10f2fc taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.821020] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-934b2684-b99c-4846-87df-66cbae10f2fc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.821020] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-23815fb9-fdde-47d3-94ea-51a989be962c taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.821020] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-23815fb9-fdde-47d3-94ea-51a989be962c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.821213] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-23815fb9-fdde-47d3-94ea-51a989be962c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.821299] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-23815fb9-fdde-47d3-94ea-51a989be962c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.821356] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('23815fb9-fdde-47d3-94ea-51a989be962c',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1272.321025] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-934b2684-b99c-4846-87df-66cbae10f2fc taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.321258] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-934b2684-b99c-4846-87df-66cbae10f2fc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.323521] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 23815fb9-fdde-47d3-94ea-51a989be962c with status ACTIVE [ 1272.323756] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.323884] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.323961] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.324176] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.324272] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.324442] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.324536] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.324605] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.324747] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.324824] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.324999] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.325104] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.325161] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.325301] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.325373] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.325454] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 23815fb9-fdde-47d3-94ea-51a989be962c is going to be updated. [ 1272.347579] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.347799] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.347799] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.348022] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.348172] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.348335] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-23815fb9-fdde-47d3-94ea-51a989be962c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.706534] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 934b2684-b99c-4846-87df-66cbae10f2fc in Status: SUCCESS [ 1272.706725] env[69232]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 934b2684-b99c-4846-87df-66cbae10f2fc deletion is rescheduled due to dependency. [ 1272.706853] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-934b2684-b99c-4846-87df-66cbae10f2fc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.707022] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-934b2684-b99c-4846-87df-66cbae10f2fc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.707248] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-934b2684-b99c-4846-87df-66cbae10f2fc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.707435] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.707552] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.707618] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.707769] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.707853] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.707948] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('934b2684-b99c-4846-87df-66cbae10f2fc',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1273.210340] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('934b2684-b99c-4846-87df-66cbae10f2fc',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1273.716615] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('934b2684-b99c-4846-87df-66cbae10f2fc',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1274.218881] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.219296] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.219296] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.219379] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.219468] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.219572] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 934b2684-b99c-4846-87df-66cbae10f2fc is going to be updated. [ 1274.248444] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.248444] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.248444] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.248849] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.248849] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.257477] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 934b2684-b99c-4846-87df-66cbae10f2fc in Status: IN_PROGRESS for 2s [ 1274.347527] env[69232]: INFO networking_nsxv3.common.synchronization [req-c384dccf-101b-43aa-a805-7415a5e66c1e req-55bb7304-d017-44d9-b4f2-aab742a56140 tempest-ServerActionsTestJSON-973196373 tempest-ServerActionsTestJSON-973196373-project-member] Enqueued Resource ID: 1eb9f24d-331e-450b-9da0-82652ecba032 with Priority: HIGHEST for action security_group_members [ 1274.348034] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1eb9f24d-331e-450b-9da0-82652ecba032 with Priority: HIGHEST for action security_group_members [ 1274.348326] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-1eb9f24d-331e-450b-9da0-82652ecba032 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.348444] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1eb9f24d-331e-450b-9da0-82652ecba032" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.348512] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1eb9f24d-331e-450b-9da0-82652ecba032" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.348708] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1eb9f24d-331e-450b-9da0-82652ecba032" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.348886] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.348985] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.353076] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.353268] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.353384] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.353534] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1eb9f24d-331e-450b-9da0-82652ecba032',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1274.860075] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.860292] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.860292] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.860546] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.860639] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.860842] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.860942] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.861015] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.861177] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.861255] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.861341] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1eb9f24d-331e-450b-9da0-82652ecba032 is going to be updated. [ 1274.888078] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.888223] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.888315] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.888512] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.888652] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.897000] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1eb9f24d-331e-450b-9da0-82652ecba032 in Status: IN_PROGRESS for 2s [ 1276.270808] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 934b2684-b99c-4846-87df-66cbae10f2fc in Status: SUCCESS [ 1276.271195] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-934b2684-b99c-4846-87df-66cbae10f2fc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.271411] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-934b2684-b99c-4846-87df-66cbae10f2fc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.271619] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-934b2684-b99c-4846-87df-66cbae10f2fc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.271842] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.271917] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.272020] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.272189] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.272289] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.272325] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-934b2684-b99c-4846-87df-66cbae10f2fc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.272406] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('934b2684-b99c-4846-87df-66cbae10f2fc',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1276.774837] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('934b2684-b99c-4846-87df-66cbae10f2fc',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1276.908733] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1eb9f24d-331e-450b-9da0-82652ecba032 in Status: SUCCESS [ 1276.908733] env[69232]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1eb9f24d-331e-450b-9da0-82652ecba032 deletion is rescheduled due to dependency. [ 1276.908733] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1eb9f24d-331e-450b-9da0-82652ecba032" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.281649] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 934b2684-b99c-4846-87df-66cbae10f2fc: rpc.has_security_group_logging(os_id): False [ 1277.299274] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.299467] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.299544] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.299793] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.299890] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.300214] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.300372] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.300421] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.300562] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.300678] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.300789] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 934b2684-b99c-4846-87df-66cbae10f2fc is going to be updated. [ 1277.369808] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.370035] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.370087] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.370320] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.370470] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.384784] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 934b2684-b99c-4846-87df-66cbae10f2fc in Status: IN_PROGRESS for 2s [ 1279.349440] env[69232]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1279.349864] env[69232]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1279.401153] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 934b2684-b99c-4846-87df-66cbae10f2fc in Status: SUCCESS [ 1279.401412] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-934b2684-b99c-4846-87df-66cbae10f2fc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.427565] env[69232]: INFO networking_nsxv3.common.synchronization [req-9e354565-6574-442e-8658-b4ceec8bd199 req-66ca416b-1d8e-4314-9be1-d8b4a69cedd5 tempest-ServerActionsTestJSON-973196373 tempest-ServerActionsTestJSON-973196373-project-member] Enqueued Resource ID: 1eb9f24d-331e-450b-9da0-82652ecba032 with Priority: HIGHEST for action security_group_members [ 1281.428087] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1eb9f24d-331e-450b-9da0-82652ecba032 with Priority: HIGHEST for action security_group_members [ 1281.428426] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-1eb9f24d-331e-450b-9da0-82652ecba032 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.430486] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1eb9f24d-331e-450b-9da0-82652ecba032" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.430486] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1eb9f24d-331e-450b-9da0-82652ecba032" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.430486] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1eb9f24d-331e-450b-9da0-82652ecba032" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.430486] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.430486] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.430486] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.430486] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.430486] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.430486] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1eb9f24d-331e-450b-9da0-82652ecba032',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1281.860577] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock network-892 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.860866] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "network-892" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.861120] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "network-892" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.861661] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "network-892" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.861799] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.862045] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.862187] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.862428] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.862584] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.862804] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1281.862957] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] NeedRegenerationException {{(pid=69232) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1281.863078] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] no value, waiting for create lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1281.863221] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] value creation lock acquired {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1281.863380] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1281.863542] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Calling creation function for not-yet-present value {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1281.863754] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1281.888832] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1281.889068] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=69232) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1281.889172] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Released creation lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1281.889359] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "network-892" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.889687] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock port-48686e18-feb3-4f4b-86eb-1da6ba06a211 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.889864] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "port-48686e18-feb3-4f4b-86eb-1da6ba06a211" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.889994] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "port-48686e18-feb3-4f4b-86eb-1da6ba06a211" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.890381] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "port-48686e18-feb3-4f4b-86eb-1da6ba06a211" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.890526] env[69232]: DEBUG networking_nsxv3.api.rpc [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('48686e18-feb3-4f4b-86eb-1da6ba06a211',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1281.936125] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.936289] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.936351] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.936574] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.936665] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.936908] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.937039] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.937080] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.937245] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.937322] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.937409] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1eb9f24d-331e-450b-9da0-82652ecba032 is going to be updated. [ 1281.963506] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.963721] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.963721] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.963918] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.964076] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.974161] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1eb9f24d-331e-450b-9da0-82652ecba032 in Status: IN_PROGRESS for 2s [ 1282.392995] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.393255] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.393390] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.393698] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.393902] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.394110] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Segment Port 48686e18-feb3-4f4b-86eb-1da6ba06a211 not found, creating... [ 1282.394455] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.394656] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.394800] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.395075] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.395248] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.395587] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.395765] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.395971] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.396233] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.396401] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.396564] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Resource: SegmentPort with ID: 48686e18-feb3-4f4b-86eb-1da6ba06a211 is going to be created. [ 1282.418595] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.418874] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.419141] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.419473] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.419811] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.420083] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "port-48686e18-feb3-4f4b-86eb-1da6ba06a211" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.108995] env[69232]: INFO networking_nsxv3.common.synchronization [req-9e354565-6574-442e-8658-b4ceec8bd199 req-3eb916c1-12ea-4be9-a47e-8618e5836cc7 service nova] Enqueued Resource ID: 1eb9f24d-331e-450b-9da0-82652ecba032 with Priority: HIGHEST for action security_group_rules [ 1283.109315] env[69232]: INFO networking_nsxv3.common.synchronization [req-9e354565-6574-442e-8658-b4ceec8bd199 req-3eb916c1-12ea-4be9-a47e-8618e5836cc7 service nova] Enqueued Resource ID: 1eb9f24d-331e-450b-9da0-82652ecba032 with Priority: HIGHEST for action security_group_members [ 1283.109486] env[69232]: INFO networking_nsxv3.common.synchronization [req-9e354565-6574-442e-8658-b4ceec8bd199 req-3eb916c1-12ea-4be9-a47e-8618e5836cc7 service nova] Enqueued Resource ID: 48686e18-feb3-4f4b-86eb-1da6ba06a211 with Priority: HIGHEST for action port [ 1283.110591] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1eb9f24d-331e-450b-9da0-82652ecba032 with Priority: HIGHEST for action security_group_rules [ 1283.110838] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1eb9f24d-331e-450b-9da0-82652ecba032 with Priority: HIGHEST for action security_group_members [ 1283.111047] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48686e18-feb3-4f4b-86eb-1da6ba06a211 with Priority: HIGHEST for action port [ 1283.111498] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1eb9f24d-331e-450b-9da0-82652ecba032 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.112391] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1eb9f24d-331e-450b-9da0-82652ecba032" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.112553] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1eb9f24d-331e-450b-9da0-82652ecba032" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.112894] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1eb9f24d-331e-450b-9da0-82652ecba032" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.113078] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1eb9f24d-331e-450b-9da0-82652ecba032',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1283.114488] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-1eb9f24d-331e-450b-9da0-82652ecba032 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.114674] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1eb9f24d-331e-450b-9da0-82652ecba032" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.115029] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-48686e18-feb3-4f4b-86eb-1da6ba06a211 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.115250] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-48686e18-feb3-4f4b-86eb-1da6ba06a211" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.115365] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-48686e18-feb3-4f4b-86eb-1da6ba06a211" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.115664] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-48686e18-feb3-4f4b-86eb-1da6ba06a211" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.115859] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('48686e18-feb3-4f4b-86eb-1da6ba06a211',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1283.618536] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-1eb9f24d-331e-450b-9da0-82652ecba032 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.618681] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1eb9f24d-331e-450b-9da0-82652ecba032" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.621055] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 48686e18-feb3-4f4b-86eb-1da6ba06a211 with status ACTIVE [ 1283.621251] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.621372] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.621859] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.621859] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.621859] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.622019] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.622019] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.622104] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.622247] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.622328] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.622510] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.622603] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.622656] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.622799] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.622873] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.622958] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 48686e18-feb3-4f4b-86eb-1da6ba06a211 is going to be updated. [ 1283.645073] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.645219] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.645301] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.645495] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.645635] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.645797] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-48686e18-feb3-4f4b-86eb-1da6ba06a211" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.983628] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1eb9f24d-331e-450b-9da0-82652ecba032 in Status: SUCCESS [ 1283.983857] env[69232]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1eb9f24d-331e-450b-9da0-82652ecba032 deletion is rescheduled due to dependency. [ 1283.984074] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1eb9f24d-331e-450b-9da0-82652ecba032" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.984152] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1eb9f24d-331e-450b-9da0-82652ecba032" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.984361] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1eb9f24d-331e-450b-9da0-82652ecba032" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.984540] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.984650] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.984707] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.984908] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.984996] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.985055] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1eb9f24d-331e-450b-9da0-82652ecba032',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1284.487338] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1eb9f24d-331e-450b-9da0-82652ecba032',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1284.989759] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1eb9f24d-331e-450b-9da0-82652ecba032',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1285.492974] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.493289] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.493289] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.493444] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.493536] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.493634] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1eb9f24d-331e-450b-9da0-82652ecba032 is going to be updated. [ 1285.523099] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.523313] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.523386] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.523599] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.523813] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.531841] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1eb9f24d-331e-450b-9da0-82652ecba032 in Status: IN_PROGRESS for 2s [ 1286.024615] env[69232]: INFO networking_nsxv3.common.synchronization [req-f5bcc2bd-7e37-4d49-93f8-165e034da0c6 req-5cbc0a8e-e1a1-4008-8ef7-35bf760cd52c tempest-AttachVolumeNegativeTest-731570695 tempest-AttachVolumeNegativeTest-731570695-project-member] Enqueued Resource ID: 88a94cb2-e4db-4ef0-87cd-a3a249cd473f with Priority: HIGHEST for action security_group_members [ 1286.025206] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88a94cb2-e4db-4ef0-87cd-a3a249cd473f with Priority: HIGHEST for action security_group_members [ 1286.025537] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-88a94cb2-e4db-4ef0-87cd-a3a249cd473f taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.025665] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88a94cb2-e4db-4ef0-87cd-a3a249cd473f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.025736] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88a94cb2-e4db-4ef0-87cd-a3a249cd473f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.025962] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88a94cb2-e4db-4ef0-87cd-a3a249cd473f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.026135] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.026284] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.026284] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.026513] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.026804] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.026804] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('88a94cb2-e4db-4ef0-87cd-a3a249cd473f',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1286.529386] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.529793] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.529793] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.529881] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.529922] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.530108] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.530228] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.530313] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.530430] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.530503] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.530574] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 88a94cb2-e4db-4ef0-87cd-a3a249cd473f is going to be updated. [ 1286.569891] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.570188] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.570188] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.570335] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.570463] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.579539] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88a94cb2-e4db-4ef0-87cd-a3a249cd473f in Status: IN_PROGRESS for 2s [ 1287.541177] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1eb9f24d-331e-450b-9da0-82652ecba032 in Status: SUCCESS [ 1287.541542] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1eb9f24d-331e-450b-9da0-82652ecba032" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.541623] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1eb9f24d-331e-450b-9da0-82652ecba032" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.541841] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1eb9f24d-331e-450b-9da0-82652ecba032" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.542047] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.542168] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.542239] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.542410] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.542496] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.542585] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1eb9f24d-331e-450b-9da0-82652ecba032" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.542680] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1eb9f24d-331e-450b-9da0-82652ecba032',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1288.044710] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1eb9f24d-331e-450b-9da0-82652ecba032',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1288.547238] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1eb9f24d-331e-450b-9da0-82652ecba032: rpc.has_security_group_logging(os_id): False [ 1288.652017] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88a94cb2-e4db-4ef0-87cd-a3a249cd473f in Status: SUCCESS [ 1288.652204] env[69232]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 88a94cb2-e4db-4ef0-87cd-a3a249cd473f deletion is rescheduled due to dependency. [ 1288.652383] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88a94cb2-e4db-4ef0-87cd-a3a249cd473f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.655391] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.655558] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.655615] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.655835] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.655960] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.656277] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.656401] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.656469] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.656666] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.656773] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.656867] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1eb9f24d-331e-450b-9da0-82652ecba032 is going to be updated. [ 1288.732425] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.732644] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.732644] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.732785] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.733155] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.746456] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1eb9f24d-331e-450b-9da0-82652ecba032 in Status: IN_PROGRESS for 2s [ 1290.763368] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1eb9f24d-331e-450b-9da0-82652ecba032 in Status: SUCCESS [ 1290.763661] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1eb9f24d-331e-450b-9da0-82652ecba032" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1291.026066] env[69232]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1291.026066] env[69232]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1296.027493] env[69232]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1296.027870] env[69232]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1301.028027] env[69232]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1301.028343] env[69232]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1303.591309] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.591729] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.591729] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.591844] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.591882] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1304.093864] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1304.597191] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1305.099917] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1305.100041] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1305.834752] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.835200] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.835200] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.835200] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.848172] env[69232]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1305.849065] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.849718] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1305.885738] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.885959] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.886031] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.886234] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.899903] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.900672] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1305.900757] env[69232]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=69232) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1305.900854] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1305.941017] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.941246] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.941246] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.941456] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.942619] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.942804] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1306.020507] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.020741] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.020741] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.020903] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.021235] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.021514] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1306.028813] env[69232]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1306.028922] env[69232]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1306.105741] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.105892] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.105954] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.106193] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.106499] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.106786] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:41. [ 1306.106879] env[69232]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'714a2506-914c-4860-b68b-819348f723d0', '3a73f146-1767-411a-a1ec-f992285edea0', '9f5186e6-2d35-4ccf-a8b4-749a0a872128', '934b2684-b99c-4846-87df-66cbae10f2fc', '461f1cb8-c9f3-4683-9685-9c2437ba8d4d', '3e5e65a3-941b-4419-9265-0dce9e80179e', 'adac9a54-9bb6-4368-a762-389898a52bd9', '88a94cb2-e4db-4ef0-87cd-a3a249cd473f', '7ee2b034-ee73-4fda-89fe-97d3d457cb9f', 'bdcc7a21-dd0d-4296-ac34-a880ea6123e7', '20ba03af-aba0-4fe6-af1e-ea103067fcbe', '0909b11c-c2d6-4d46-9a46-74243fd12a97', '51642e84-0020-4045-91ab-e7c13f6d7a75', 'fb3494b9-4ce5-4744-a378-ecbcd5c2bec9', 'be581393-4638-4971-8e7f-56047ad132ae', '7f6a976f-5d10-4e43-b677-d3a20b1ba925', '345ff80e-1d3c-4ccc-95f9-bc828bfd5095', '4843729c-bd07-48e1-9798-7dc90829718d', 'e5f0070b-6fd5-4e89-a697-f74b50d1833f', 'abd587ac-a2db-4962-b166-638ba1590646', '83d1cdee-a934-490e-9869-707c6882be9d', '5aeb42e6-43fc-4b3e-96b5-dc4a9cddb10c', '1eb9f24d-331e-450b-9da0-82652ecba032', '5435d71f-3832-4f11-be57-bef3011dd7b7', '06438b8f-6cee-4263-9d4c-43067bbe0a4c', 'dcd9f79f-c997-4a2d-83a2-472c849b1794', 'd95c4c9e-2568-4fbb-8231-ae683e08215e', '96a06bfd-a7ad-4644-89c3-3168aa1fdf2e', 'e18d5d2b-f965-404d-b211-f58621ceccf1', '9ea0b8f1-7dc8-48fd-bd49-a3ae8c7a9645', '5a45a455-673b-417d-b2f6-be9352c2077e', '131f51ef-2833-4453-914e-c87497d66ff6', '6544a871-f802-46ae-a314-241911fc9dda', 'f75b07e5-04f2-4dc3-80ad-ba8105cb4c82', 'c042e2fd-851d-4970-9cfd-994d6fa3bc3a', '8e5c2d57-e29a-48c5-977d-f19d1fe77c00', '774040f6-0f3c-4707-b677-d815b078404c', '24c49db3-d2db-437b-976f-e83851ddd42c', 'b403d6f4-9cfd-407a-9a3f-9a486dae20dc', '15a3e0ef-3467-49d4-a8b2-072fce21b190', '9dfe0542-c4f4-46ef-bdfa-784cec941ec2'} {{(pid=69232) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1306.106976] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1306.126597] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.126808] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.126808] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.126992] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.127093] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.127196] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1306.127269] env[69232]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=69232) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1306.127323] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1306.196587] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.196807] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.196807] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.196991] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.198182] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.198472] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1306.198559] env[69232]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=69232) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1306.198635] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1306.198701] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1306.198780] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/41 resources of Type:Security Group Rules [ 1306.198852] env[69232]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 714a2506-914c-4860-b68b-819348f723d0 with Priority: HIGH for action security_group_rules [ 1306.198931] env[69232]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3a73f146-1767-411a-a1ec-f992285edea0 with Priority: HIGH for action security_group_rules [ 1306.198992] env[69232]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9f5186e6-2d35-4ccf-a8b4-749a0a872128 with Priority: HIGH for action security_group_rules [ 1306.199066] env[69232]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 934b2684-b99c-4846-87df-66cbae10f2fc with Priority: HIGH for action security_group_rules [ 1306.199127] env[69232]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 461f1cb8-c9f3-4683-9685-9c2437ba8d4d with Priority: HIGH for action security_group_rules [ 1306.199195] env[69232]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3e5e65a3-941b-4419-9265-0dce9e80179e with Priority: HIGH for action security_group_rules [ 1306.199405] env[69232]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: adac9a54-9bb6-4368-a762-389898a52bd9 with Priority: HIGH for action security_group_rules [ 1306.199405] env[69232]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 88a94cb2-e4db-4ef0-87cd-a3a249cd473f with Priority: HIGH for action security_group_rules [ 1306.199544] env[69232]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7ee2b034-ee73-4fda-89fe-97d3d457cb9f with Priority: HIGH for action security_group_rules [ 1306.199544] env[69232]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: bdcc7a21-dd0d-4296-ac34-a880ea6123e7 with Priority: HIGH for action security_group_rules [ 1306.199611] env[69232]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 20ba03af-aba0-4fe6-af1e-ea103067fcbe with Priority: HIGH for action security_group_rules [ 1306.199647] env[69232]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0909b11c-c2d6-4d46-9a46-74243fd12a97 with Priority: HIGH for action security_group_rules [ 1306.199680] env[69232]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 51642e84-0020-4045-91ab-e7c13f6d7a75 with Priority: HIGH for action security_group_rules [ 1306.199759] env[69232]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: fb3494b9-4ce5-4744-a378-ecbcd5c2bec9 with Priority: HIGH for action security_group_rules [ 1306.199826] env[69232]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: be581393-4638-4971-8e7f-56047ad132ae with Priority: HIGH for action security_group_rules [ 1306.199874] env[69232]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7f6a976f-5d10-4e43-b677-d3a20b1ba925 with Priority: HIGH for action security_group_rules [ 1306.199921] env[69232]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 345ff80e-1d3c-4ccc-95f9-bc828bfd5095 with Priority: HIGH for action security_group_rules [ 1306.199972] env[69232]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4843729c-bd07-48e1-9798-7dc90829718d with Priority: HIGH for action security_group_rules [ 1306.200028] env[69232]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e5f0070b-6fd5-4e89-a697-f74b50d1833f with Priority: HIGH for action security_group_rules [ 1306.200091] env[69232]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: abd587ac-a2db-4962-b166-638ba1590646 with Priority: HIGH for action security_group_rules [ 1306.200183] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.030020] env[69232]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1311.030020] env[69232]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=20], Jobs=0 [ 1311.030020] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 714a2506-914c-4860-b68b-819348f723d0 with Priority: HIGH for action security_group_rules [ 1311.030020] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f5186e6-2d35-4ccf-a8b4-749a0a872128 with Priority: HIGH for action security_group_rules [ 1311.030593] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: adac9a54-9bb6-4368-a762-389898a52bd9 with Priority: HIGH for action security_group_rules [ 1311.030593] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: be581393-4638-4971-8e7f-56047ad132ae with Priority: HIGH for action security_group_rules [ 1311.030593] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: abd587ac-a2db-4962-b166-638ba1590646 with Priority: HIGH for action security_group_rules [ 1311.030593] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5f0070b-6fd5-4e89-a697-f74b50d1833f with Priority: HIGH for action security_group_rules [ 1311.030593] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4843729c-bd07-48e1-9798-7dc90829718d with Priority: HIGH for action security_group_rules [ 1311.030593] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 345ff80e-1d3c-4ccc-95f9-bc828bfd5095 with Priority: HIGH for action security_group_rules [ 1311.030879] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb3494b9-4ce5-4744-a378-ecbcd5c2bec9 with Priority: HIGH for action security_group_rules [ 1311.030879] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f6a976f-5d10-4e43-b677-d3a20b1ba925 with Priority: HIGH for action security_group_rules [ 1311.030879] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 51642e84-0020-4045-91ab-e7c13f6d7a75 with Priority: HIGH for action security_group_rules [ 1311.031070] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0909b11c-c2d6-4d46-9a46-74243fd12a97 with Priority: HIGH for action security_group_rules [ 1311.031070] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20ba03af-aba0-4fe6-af1e-ea103067fcbe with Priority: HIGH for action security_group_rules [ 1311.031140] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdcc7a21-dd0d-4296-ac34-a880ea6123e7 with Priority: HIGH for action security_group_rules [ 1311.031175] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ee2b034-ee73-4fda-89fe-97d3d457cb9f with Priority: HIGH for action security_group_rules [ 1311.031262] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e5e65a3-941b-4419-9265-0dce9e80179e with Priority: HIGH for action security_group_rules [ 1311.031330] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88a94cb2-e4db-4ef0-87cd-a3a249cd473f with Priority: HIGH for action security_group_rules [ 1311.031417] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 461f1cb8-c9f3-4683-9685-9c2437ba8d4d with Priority: HIGH for action security_group_rules [ 1311.031500] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a73f146-1767-411a-a1ec-f992285edea0 with Priority: HIGH for action security_group_rules [ 1311.031586] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 934b2684-b99c-4846-87df-66cbae10f2fc with Priority: HIGH for action security_group_rules [ 1311.031941] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-714a2506-914c-4860-b68b-819348f723d0 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.032086] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-714a2506-914c-4860-b68b-819348f723d0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.032153] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-714a2506-914c-4860-b68b-819348f723d0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.032351] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-714a2506-914c-4860-b68b-819348f723d0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.032434] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('714a2506-914c-4860-b68b-819348f723d0',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1311.033796] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9f5186e6-2d35-4ccf-a8b4-749a0a872128 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.033916] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.034021] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.034193] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.034271] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9f5186e6-2d35-4ccf-a8b4-749a0a872128',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1311.035059] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-adac9a54-9bb6-4368-a762-389898a52bd9 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.035170] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-adac9a54-9bb6-4368-a762-389898a52bd9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.035235] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-adac9a54-9bb6-4368-a762-389898a52bd9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.035385] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-adac9a54-9bb6-4368-a762-389898a52bd9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.035457] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('adac9a54-9bb6-4368-a762-389898a52bd9',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1311.036200] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-be581393-4638-4971-8e7f-56047ad132ae taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.036339] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-be581393-4638-4971-8e7f-56047ad132ae" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.036395] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-be581393-4638-4971-8e7f-56047ad132ae" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.036537] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-be581393-4638-4971-8e7f-56047ad132ae" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.036605] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('be581393-4638-4971-8e7f-56047ad132ae',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1311.037521] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-abd587ac-a2db-4962-b166-638ba1590646 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.037521] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-abd587ac-a2db-4962-b166-638ba1590646" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.037521] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-abd587ac-a2db-4962-b166-638ba1590646" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.037827] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-abd587ac-a2db-4962-b166-638ba1590646" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.037827] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('abd587ac-a2db-4962-b166-638ba1590646',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1311.038426] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e5f0070b-6fd5-4e89-a697-f74b50d1833f taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.038541] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e5f0070b-6fd5-4e89-a697-f74b50d1833f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.038596] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e5f0070b-6fd5-4e89-a697-f74b50d1833f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.038735] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e5f0070b-6fd5-4e89-a697-f74b50d1833f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.038805] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e5f0070b-6fd5-4e89-a697-f74b50d1833f',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1311.039498] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4843729c-bd07-48e1-9798-7dc90829718d taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.039604] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4843729c-bd07-48e1-9798-7dc90829718d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.039651] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4843729c-bd07-48e1-9798-7dc90829718d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.040222] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4843729c-bd07-48e1-9798-7dc90829718d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.040222] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4843729c-bd07-48e1-9798-7dc90829718d',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1311.040561] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-345ff80e-1d3c-4ccc-95f9-bc828bfd5095 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.040665] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-345ff80e-1d3c-4ccc-95f9-bc828bfd5095" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.040725] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-345ff80e-1d3c-4ccc-95f9-bc828bfd5095" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.040870] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-345ff80e-1d3c-4ccc-95f9-bc828bfd5095" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.040932] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('345ff80e-1d3c-4ccc-95f9-bc828bfd5095',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1311.041610] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.041728] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.041786] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.041913] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.041981] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fb3494b9-4ce5-4744-a378-ecbcd5c2bec9',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1311.042771] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7f6a976f-5d10-4e43-b677-d3a20b1ba925 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.042877] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7f6a976f-5d10-4e43-b677-d3a20b1ba925" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.042950] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7f6a976f-5d10-4e43-b677-d3a20b1ba925" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.043100] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7f6a976f-5d10-4e43-b677-d3a20b1ba925" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.043175] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7f6a976f-5d10-4e43-b677-d3a20b1ba925',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1311.043820] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-51642e84-0020-4045-91ab-e7c13f6d7a75 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.043926] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-51642e84-0020-4045-91ab-e7c13f6d7a75" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.043986] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-51642e84-0020-4045-91ab-e7c13f6d7a75" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.044168] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-51642e84-0020-4045-91ab-e7c13f6d7a75" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.044280] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('51642e84-0020-4045-91ab-e7c13f6d7a75',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1311.044938] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0909b11c-c2d6-4d46-9a46-74243fd12a97 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.044988] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0909b11c-c2d6-4d46-9a46-74243fd12a97" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.045070] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0909b11c-c2d6-4d46-9a46-74243fd12a97" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.045206] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0909b11c-c2d6-4d46-9a46-74243fd12a97" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.045278] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0909b11c-c2d6-4d46-9a46-74243fd12a97',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1311.046056] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-20ba03af-aba0-4fe6-af1e-ea103067fcbe taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.046185] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-20ba03af-aba0-4fe6-af1e-ea103067fcbe" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.046256] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-20ba03af-aba0-4fe6-af1e-ea103067fcbe" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.046392] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-20ba03af-aba0-4fe6-af1e-ea103067fcbe" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.046466] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('20ba03af-aba0-4fe6-af1e-ea103067fcbe',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1311.047125] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bdcc7a21-dd0d-4296-ac34-a880ea6123e7 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.047226] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.047279] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.047431] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.047503] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bdcc7a21-dd0d-4296-ac34-a880ea6123e7',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1311.048167] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7ee2b034-ee73-4fda-89fe-97d3d457cb9f taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.048273] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7ee2b034-ee73-4fda-89fe-97d3d457cb9f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.048333] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7ee2b034-ee73-4fda-89fe-97d3d457cb9f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.048517] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7ee2b034-ee73-4fda-89fe-97d3d457cb9f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.048607] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7ee2b034-ee73-4fda-89fe-97d3d457cb9f',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1311.049253] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3e5e65a3-941b-4419-9265-0dce9e80179e taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.049359] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3e5e65a3-941b-4419-9265-0dce9e80179e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.049412] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3e5e65a3-941b-4419-9265-0dce9e80179e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.049560] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3e5e65a3-941b-4419-9265-0dce9e80179e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.049629] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3e5e65a3-941b-4419-9265-0dce9e80179e',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1311.050375] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-88a94cb2-e4db-4ef0-87cd-a3a249cd473f taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.050470] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-88a94cb2-e4db-4ef0-87cd-a3a249cd473f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.050536] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-88a94cb2-e4db-4ef0-87cd-a3a249cd473f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.050683] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-88a94cb2-e4db-4ef0-87cd-a3a249cd473f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.050769] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('88a94cb2-e4db-4ef0-87cd-a3a249cd473f',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1311.051423] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-461f1cb8-c9f3-4683-9685-9c2437ba8d4d taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.051537] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-461f1cb8-c9f3-4683-9685-9c2437ba8d4d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.051602] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-461f1cb8-c9f3-4683-9685-9c2437ba8d4d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.051749] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-461f1cb8-c9f3-4683-9685-9c2437ba8d4d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.051820] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('461f1cb8-c9f3-4683-9685-9c2437ba8d4d',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1311.052478] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3a73f146-1767-411a-a1ec-f992285edea0 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.052592] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3a73f146-1767-411a-a1ec-f992285edea0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.052653] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3a73f146-1767-411a-a1ec-f992285edea0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.052789] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3a73f146-1767-411a-a1ec-f992285edea0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.052860] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3a73f146-1767-411a-a1ec-f992285edea0',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1311.053605] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-934b2684-b99c-4846-87df-66cbae10f2fc taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.053709] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-934b2684-b99c-4846-87df-66cbae10f2fc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.053818] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-934b2684-b99c-4846-87df-66cbae10f2fc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.053915] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-934b2684-b99c-4846-87df-66cbae10f2fc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.054038] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('934b2684-b99c-4846-87df-66cbae10f2fc',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1311.556026] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e5e65a3-941b-4419-9265-0dce9e80179e taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.556237] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e5e65a3-941b-4419-9265-0dce9e80179e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.556292] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e5e65a3-941b-4419-9265-0dce9e80179e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.556491] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e5e65a3-941b-4419-9265-0dce9e80179e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.556656] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.556770] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.556848] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.556955] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.557050] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.557136] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e5e65a3-941b-4419-9265-0dce9e80179e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.557225] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3e5e65a3-941b-4419-9265-0dce9e80179e',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1311.572115] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a73f146-1767-411a-a1ec-f992285edea0 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.572297] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a73f146-1767-411a-a1ec-f992285edea0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.572396] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a73f146-1767-411a-a1ec-f992285edea0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.572605] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a73f146-1767-411a-a1ec-f992285edea0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.572778] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.572882] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.572942] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.573131] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.573218] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.573307] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a73f146-1767-411a-a1ec-f992285edea0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.573438] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3a73f146-1767-411a-a1ec-f992285edea0',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1311.579448] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-934b2684-b99c-4846-87df-66cbae10f2fc taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.579590] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-934b2684-b99c-4846-87df-66cbae10f2fc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.579649] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-934b2684-b99c-4846-87df-66cbae10f2fc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.579822] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-934b2684-b99c-4846-87df-66cbae10f2fc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.579984] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.580121] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.580239] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.580360] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.580457] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.580538] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-934b2684-b99c-4846-87df-66cbae10f2fc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.580701] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('934b2684-b99c-4846-87df-66cbae10f2fc',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1311.585845] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3a73f146-1767-411a-a1ec-f992285edea0',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1311.595101] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('934b2684-b99c-4846-87df-66cbae10f2fc',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1311.596137] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3a73f146-1767-411a-a1ec-f992285edea0: rpc.has_security_group_logging(os_id): False [ 1311.626563] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.626789] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.626789] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.626983] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.628588] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.628688] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.630045] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.630159] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.638625] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.638822] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.640403] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.640503] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.641220] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.641313] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.642037] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.642213] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.642877] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.643019] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.643974] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.644133] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.644843] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.644958] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.645650] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.645776] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.646442] env[69232]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1311.646778] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.646920] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.647566] env[69232]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1311.647960] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.648082] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.648650] env[69232]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1311.649054] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.649188] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.649874] env[69232]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1311.650282] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.650423] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.650938] env[69232]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1311.651338] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.651447] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.652046] env[69232]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1311.652405] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.652519] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.653110] env[69232]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1311.653472] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.653612] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.654123] env[69232]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1311.654532] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.654663] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fb3494b9-4ce5-4744-a378-ecbcd5c2bec9 is going to be deleted. [ 1311.655546] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.655762] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.673338] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.673483] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 20ba03af-aba0-4fe6-af1e-ea103067fcbe is going to be deleted. [ 1311.674326] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.674535] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.691008] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.691157] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 88a94cb2-e4db-4ef0-87cd-a3a249cd473f is going to be deleted. [ 1311.691981] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.692194] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.715145] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.715374] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.718341] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.718476] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: be581393-4638-4971-8e7f-56047ad132ae is going to be deleted. [ 1311.719352] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.719565] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.721553] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.721756] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.741879] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.742081] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: abd587ac-a2db-4962-b166-638ba1590646 is going to be deleted. [ 1311.742915] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.743137] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.760804] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.761054] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.771853] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.772044] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bdcc7a21-dd0d-4296-ac34-a880ea6123e7 is going to be deleted. [ 1311.772947] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.773186] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.789045] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.789259] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.850689] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.850861] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e5f0070b-6fd5-4e89-a697-f74b50d1833f is going to be deleted. [ 1311.851749] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.851985] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.863854] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.864088] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.891734] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.891923] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 345ff80e-1d3c-4ccc-95f9-bc828bfd5095 is going to be deleted. [ 1311.892792] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.893059] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.894987] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.895139] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.943165] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.943393] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 714a2506-914c-4860-b68b-819348f723d0 is going to be deleted. [ 1311.944309] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.944533] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.968191] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.968425] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.994606] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.994798] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: adac9a54-9bb6-4368-a762-389898a52bd9 is going to be deleted. [ 1311.995750] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.995993] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.003655] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.003883] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.044405] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.044811] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.045468] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.045591] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0909b11c-c2d6-4d46-9a46-74243fd12a97 is going to be deleted. [ 1312.046522] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.046737] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.065525] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3e5e65a3-941b-4419-9265-0dce9e80179e',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1312.094960] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.095171] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 461f1cb8-c9f3-4683-9685-9c2437ba8d4d is going to be deleted. [ 1312.096022] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.096293] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.105072] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 934b2684-b99c-4846-87df-66cbae10f2fc: rpc.has_security_group_logging(os_id): False [ 1312.158390] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.158624] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.169225] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.169407] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9f5186e6-2d35-4ccf-a8b4-749a0a872128 is going to be deleted. [ 1312.170323] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.170554] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.172560] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.172736] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.242144] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.242368] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4843729c-bd07-48e1-9798-7dc90829718d is going to be deleted. [ 1312.243701] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.244024] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.280505] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.280725] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.286973] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.287171] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.289938] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.290093] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.292115] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.292234] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 51642e84-0020-4045-91ab-e7c13f6d7a75 is going to be deleted. [ 1312.293132] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.293343] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.346515] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.346722] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7f6a976f-5d10-4e43-b677-d3a20b1ba925 is going to be deleted. [ 1312.347563] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.347776] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.410254] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.410393] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7ee2b034-ee73-4fda-89fe-97d3d457cb9f is going to be deleted. [ 1312.411345] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.411666] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.413706] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.413776] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.423587] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.424244] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.498565] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.498963] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.499085] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.499167] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.499437] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.499553] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.499673] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3a73f146-1767-411a-a1ec-f992285edea0 is going to be updated. [ 1312.500808] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.501015] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.501094] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.501204] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fb3494b9-4ce5-4744-a378-ecbcd5c2bec9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.501340] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.501489] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.501564] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.501672] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-20ba03af-aba0-4fe6-af1e-ea103067fcbe" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.502437] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.502550] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.502604] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.502754] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.502833] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.502945] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7f6a976f-5d10-4e43-b677-d3a20b1ba925" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.503092] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.503237] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.503315] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.503428] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-88a94cb2-e4db-4ef0-87cd-a3a249cd473f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.503539] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.503684] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.503781] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.503899] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-be581393-4638-4971-8e7f-56047ad132ae" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.504511] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.504722] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.504826] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.504926] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-abd587ac-a2db-4962-b166-638ba1590646" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.505080] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.505232] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.505311] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.505424] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bdcc7a21-dd0d-4296-ac34-a880ea6123e7" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.505534] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.505678] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.505764] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.505858] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e5f0070b-6fd5-4e89-a697-f74b50d1833f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.505989] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.506163] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.506282] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.506365] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-345ff80e-1d3c-4ccc-95f9-bc828bfd5095" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.506501] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.506643] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.506717] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.506826] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-714a2506-914c-4860-b68b-819348f723d0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.506938] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.507092] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.519532] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.519727] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.561741] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.562087] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.562185] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.562269] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.562509] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.562595] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.562698] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 934b2684-b99c-4846-87df-66cbae10f2fc is going to be updated. [ 1312.563819] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.564018] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.564124] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.564244] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0909b11c-c2d6-4d46-9a46-74243fd12a97" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.564397] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.564587] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.564670] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.564785] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-461f1cb8-c9f3-4683-9685-9c2437ba8d4d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.564947] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.565110] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.565185] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.565314] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4843729c-bd07-48e1-9798-7dc90829718d" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.565419] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.565563] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.565637] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.565778] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-51642e84-0020-4045-91ab-e7c13f6d7a75" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.566481] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.566689] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.566788] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.566916] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-adac9a54-9bb6-4368-a762-389898a52bd9" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.567056] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.567229] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.567313] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.567422] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9f5186e6-2d35-4ccf-a8b4-749a0a872128" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.567564] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.567707] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.567784] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.567896] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7ee2b034-ee73-4fda-89fe-97d3d457cb9f" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.568115] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3e5e65a3-941b-4419-9265-0dce9e80179e: rpc.has_security_group_logging(os_id): False [ 1312.606272] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.606491] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.606491] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.606708] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.651964] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.652238] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.652450] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.652450] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.652625] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.652709] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.652796] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3e5e65a3-941b-4419-9265-0dce9e80179e is going to be updated. [ 1312.671596] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.671832] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.671832] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.671993] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.672161] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.712993] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3a73f146-1767-411a-a1ec-f992285edea0 in Status: IN_PROGRESS for 2s [ 1312.720745] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.720927] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.720967] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.721207] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.721350] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.739384] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 934b2684-b99c-4846-87df-66cbae10f2fc in Status: IN_PROGRESS for 2s [ 1312.759895] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.760130] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.760130] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.760333] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.760483] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.780141] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3e5e65a3-941b-4419-9265-0dce9e80179e in Status: IN_PROGRESS for 2s [ 1314.725980] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3a73f146-1767-411a-a1ec-f992285edea0 in Status: SUCCESS [ 1314.726483] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3a73f146-1767-411a-a1ec-f992285edea0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.752037] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 934b2684-b99c-4846-87df-66cbae10f2fc in Status: SUCCESS [ 1314.752276] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-934b2684-b99c-4846-87df-66cbae10f2fc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.791968] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3e5e65a3-941b-4419-9265-0dce9e80179e in Status: SUCCESS [ 1314.792219] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3e5e65a3-941b-4419-9265-0dce9e80179e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.032311] env[69232]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1316.032697] env[69232]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1321.033280] env[69232]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1321.033633] env[69232]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1323.133426] env[69232]: INFO networking_nsxv3.common.synchronization [req-6be8cb12-572e-4342-91ba-529b57fb3a0b req-d31d0890-4a7a-4984-b51f-9034d1be42dd tempest-ServerActionsTestOtherA-781098598 tempest-ServerActionsTestOtherA-781098598-project-member] Enqueued Resource ID: 3e5e65a3-941b-4419-9265-0dce9e80179e with Priority: HIGHEST for action security_group_members [ 1323.134370] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e5e65a3-941b-4419-9265-0dce9e80179e with Priority: HIGHEST for action security_group_members [ 1323.134730] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e5e65a3-941b-4419-9265-0dce9e80179e taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.134873] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e5e65a3-941b-4419-9265-0dce9e80179e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.134941] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e5e65a3-941b-4419-9265-0dce9e80179e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.135164] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e5e65a3-941b-4419-9265-0dce9e80179e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.135548] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.135680] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.135742] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.135908] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.135993] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.136109] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3e5e65a3-941b-4419-9265-0dce9e80179e',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1323.638840] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3e5e65a3-941b-4419-9265-0dce9e80179e',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1324.141090] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3e5e65a3-941b-4419-9265-0dce9e80179e',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1324.644262] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.644602] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.644789] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.644924] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.645065] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.645194] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3e5e65a3-941b-4419-9265-0dce9e80179e is going to be updated. [ 1324.682764] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.683032] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.683032] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.683262] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.683262] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.693218] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e5e65a3-941b-4419-9265-0dce9e80179e in Status: IN_PROGRESS for 2s [ 1326.704684] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e5e65a3-941b-4419-9265-0dce9e80179e in Status: SUCCESS [ 1326.705111] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e5e65a3-941b-4419-9265-0dce9e80179e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.136033] env[69232]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1328.136387] env[69232]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1333.137447] env[69232]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1333.137851] env[69232]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1337.291016] env[69232]: INFO networking_nsxv3.common.synchronization [req-a6d93a0c-882d-4c62-aa06-6dd4509fd2b8 req-371f5d13-7d70-4b85-aae2-aad1c84a3d28 tempest-AttachVolumeTestJSON-1679696077 tempest-AttachVolumeTestJSON-1679696077-project-member] Enqueued Resource ID: 3a73f146-1767-411a-a1ec-f992285edea0 with Priority: HIGHEST for action security_group_members [ 1337.291549] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a73f146-1767-411a-a1ec-f992285edea0 with Priority: HIGHEST for action security_group_members [ 1337.291960] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a73f146-1767-411a-a1ec-f992285edea0 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1337.292082] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a73f146-1767-411a-a1ec-f992285edea0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1337.292169] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a73f146-1767-411a-a1ec-f992285edea0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1337.292350] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a73f146-1767-411a-a1ec-f992285edea0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1337.292502] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1337.292604] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1337.292666] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1337.292806] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1337.292893] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1337.293060] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3a73f146-1767-411a-a1ec-f992285edea0',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1337.795848] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1337.796023] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1337.796097] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1337.796321] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1337.796412] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1337.796676] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1337.796781] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1337.796846] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1337.796999] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1337.797096] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1337.797183] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3a73f146-1767-411a-a1ec-f992285edea0 is going to be updated. [ 1337.826876] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1337.827106] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1337.827106] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1337.827287] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1337.827426] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1337.835415] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3a73f146-1767-411a-a1ec-f992285edea0 in Status: IN_PROGRESS for 2s [ 1339.640326] env[69232]: INFO networking_nsxv3.common.synchronization [req-6b7f56bc-c0b6-46b7-94d4-cd1a64ef370b req-3c748c5b-7920-477c-92e5-88e801f5cb3e tempest-ServerActionsTestOtherA-781098598 tempest-ServerActionsTestOtherA-781098598-project-member] Enqueued Resource ID: 3e5e65a3-941b-4419-9265-0dce9e80179e with Priority: HIGHEST for action security_group_members [ 1339.640326] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e5e65a3-941b-4419-9265-0dce9e80179e with Priority: HIGHEST for action security_group_members [ 1339.640620] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e5e65a3-941b-4419-9265-0dce9e80179e taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.640674] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e5e65a3-941b-4419-9265-0dce9e80179e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.640718] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e5e65a3-941b-4419-9265-0dce9e80179e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.641271] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e5e65a3-941b-4419-9265-0dce9e80179e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.641271] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.641271] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.641271] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.641533] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.641533] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.641533] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3e5e65a3-941b-4419-9265-0dce9e80179e',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1339.850196] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3a73f146-1767-411a-a1ec-f992285edea0 in Status: SUCCESS [ 1339.850422] env[69232]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3a73f146-1767-411a-a1ec-f992285edea0 deletion is rescheduled due to dependency. [ 1339.850483] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a73f146-1767-411a-a1ec-f992285edea0" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1340.143912] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1340.144169] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1340.144169] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1340.144413] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1340.144533] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1340.144766] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1340.144889] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1340.144962] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1340.145167] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1340.145253] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1340.145355] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3e5e65a3-941b-4419-9265-0dce9e80179e is going to be updated. [ 1340.171473] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1340.171693] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1340.171753] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1340.172038] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1340.172238] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1340.183338] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e5e65a3-941b-4419-9265-0dce9e80179e in Status: IN_PROGRESS for 2s [ 1342.198109] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e5e65a3-941b-4419-9265-0dce9e80179e in Status: SUCCESS [ 1342.198799] env[69232]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3e5e65a3-941b-4419-9265-0dce9e80179e deletion is rescheduled due to dependency. [ 1342.198799] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e5e65a3-941b-4419-9265-0dce9e80179e" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.251237] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock network-424 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1342.251452] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "network-424" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.251584] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "network-424" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1342.251883] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "network-424" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1342.252214] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1342.252389] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.252513] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1342.252766] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1342.252877] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.253257] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1342.253385] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] NeedRegenerationException {{(pid=69232) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1342.253501] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] no value, waiting for create lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1342.253620] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] value creation lock acquired {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1342.253756] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1342.253838] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Calling creation function for not-yet-present value {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1342.253977] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1342.276890] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1342.277166] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69232) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1342.277291] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Released creation lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1342.277408] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "network-424" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.277735] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock port-23815fb9-fdde-47d3-94ea-51a989be962c taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1342.277914] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "port-23815fb9-fdde-47d3-94ea-51a989be962c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.278052] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "port-23815fb9-fdde-47d3-94ea-51a989be962c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1342.278332] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "port-23815fb9-fdde-47d3-94ea-51a989be962c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1342.278529] env[69232]: DEBUG networking_nsxv3.api.rpc [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('23815fb9-fdde-47d3-94ea-51a989be962c',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1342.780813] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1342.781186] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.781408] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1342.781823] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1342.782102] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.782559] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1342.782826] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.783047] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1342.783430] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1342.783682] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.784156] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1342.784435] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.784621] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1342.784961] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1342.785216] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.785454] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Resource: SegmentPort with ID: 23815fb9-fdde-47d3-94ea-51a989be962c is going to be updated. [ 1342.808795] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1342.809065] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.809178] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1342.809463] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1342.809665] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.809897] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "port-23815fb9-fdde-47d3-94ea-51a989be962c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.500752] env[69232]: INFO networking_nsxv3.common.synchronization [req-84ddd7ce-78cd-4f4b-beef-99e6a57571f8 req-c51baa54-c56b-49f7-90e5-4f20c17d8d4a service nova] Enqueued Resource ID: 934b2684-b99c-4846-87df-66cbae10f2fc with Priority: HIGHEST for action security_group_rules [ 1343.501240] env[69232]: INFO networking_nsxv3.common.synchronization [req-84ddd7ce-78cd-4f4b-beef-99e6a57571f8 req-c51baa54-c56b-49f7-90e5-4f20c17d8d4a service nova] Enqueued Resource ID: 934b2684-b99c-4846-87df-66cbae10f2fc with Priority: HIGHEST for action security_group_members [ 1343.501240] env[69232]: INFO networking_nsxv3.common.synchronization [req-84ddd7ce-78cd-4f4b-beef-99e6a57571f8 req-c51baa54-c56b-49f7-90e5-4f20c17d8d4a service nova] Enqueued Resource ID: 23815fb9-fdde-47d3-94ea-51a989be962c with Priority: HIGHEST for action port [ 1343.501702] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 934b2684-b99c-4846-87df-66cbae10f2fc with Priority: HIGHEST for action security_group_rules [ 1343.501843] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 934b2684-b99c-4846-87df-66cbae10f2fc with Priority: HIGHEST for action security_group_members [ 1343.501955] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23815fb9-fdde-47d3-94ea-51a989be962c with Priority: HIGHEST for action port [ 1343.502511] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-934b2684-b99c-4846-87df-66cbae10f2fc taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.502661] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-934b2684-b99c-4846-87df-66cbae10f2fc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.502733] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-934b2684-b99c-4846-87df-66cbae10f2fc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.502945] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-934b2684-b99c-4846-87df-66cbae10f2fc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.503076] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('934b2684-b99c-4846-87df-66cbae10f2fc',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1343.504064] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-934b2684-b99c-4846-87df-66cbae10f2fc taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.504188] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-934b2684-b99c-4846-87df-66cbae10f2fc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.504251] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-934b2684-b99c-4846-87df-66cbae10f2fc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.504438] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-934b2684-b99c-4846-87df-66cbae10f2fc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.504605] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.504687] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.504759] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.504920] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.505039] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.505174] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('934b2684-b99c-4846-87df-66cbae10f2fc',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1343.506077] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-23815fb9-fdde-47d3-94ea-51a989be962c taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.506125] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-23815fb9-fdde-47d3-94ea-51a989be962c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.506166] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-23815fb9-fdde-47d3-94ea-51a989be962c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.506326] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-23815fb9-fdde-47d3-94ea-51a989be962c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.506694] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('23815fb9-fdde-47d3-94ea-51a989be962c',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1344.008377] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('934b2684-b99c-4846-87df-66cbae10f2fc',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1344.009580] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-934b2684-b99c-4846-87df-66cbae10f2fc taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.009773] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-934b2684-b99c-4846-87df-66cbae10f2fc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.009939] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 23815fb9-fdde-47d3-94ea-51a989be962c with status ACTIVE [ 1344.010062] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.010179] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.010249] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.010408] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.010495] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.010675] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.010772] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.010826] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.010980] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.011595] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.011799] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.011894] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.011958] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.012287] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.012403] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.012497] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 23815fb9-fdde-47d3-94ea-51a989be962c is going to be updated. [ 1344.038411] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.038662] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.038662] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.038860] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.039581] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.039581] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-23815fb9-fdde-47d3-94ea-51a989be962c" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.514257] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('934b2684-b99c-4846-87df-66cbae10f2fc',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1344.889917] env[69232]: INFO networking_nsxv3.common.synchronization [req-2352bfcf-797e-4d28-b9e9-9d3bb4bdd4f7 req-0bae4c8c-4bdf-440a-a655-746f9fdfe8be tempest-ServerActionsTestJSON-973196373 tempest-ServerActionsTestJSON-973196373-project-member] Enqueued Resource ID: 1eb9f24d-331e-450b-9da0-82652ecba032 with Priority: HIGHEST for action security_group_members [ 1344.891247] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1eb9f24d-331e-450b-9da0-82652ecba032 with Priority: HIGHEST for action security_group_members [ 1344.891247] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-1eb9f24d-331e-450b-9da0-82652ecba032 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.891247] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1eb9f24d-331e-450b-9da0-82652ecba032" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.891247] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1eb9f24d-331e-450b-9da0-82652ecba032" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.892259] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1eb9f24d-331e-450b-9da0-82652ecba032" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.892259] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.892259] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.892259] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.892259] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.892259] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.892259] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1eb9f24d-331e-450b-9da0-82652ecba032',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1345.016809] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.017048] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.017048] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.017280] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.017389] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.017480] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 934b2684-b99c-4846-87df-66cbae10f2fc is going to be updated. [ 1345.051570] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.051847] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.051847] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.051999] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.052177] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.061837] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 934b2684-b99c-4846-87df-66cbae10f2fc in Status: IN_PROGRESS for 2s [ 1345.243672] env[69232]: INFO networking_nsxv3.common.synchronization [None req-58d8ee26-be53-42a1-879f-ba9f1c60c4c2 tempest-AttachVolumeTestJSON-1679696077 tempest-AttachVolumeTestJSON-1679696077-project-member] Enqueued Resource ID: 90ff229f-2aa3-4ddd-93ca-816af7f2d674 with Priority: HIGHEST for action security_group_rules [ 1345.244675] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 90ff229f-2aa3-4ddd-93ca-816af7f2d674 with Priority: HIGHEST for action security_group_rules [ 1345.245055] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-90ff229f-2aa3-4ddd-93ca-816af7f2d674 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.245183] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-90ff229f-2aa3-4ddd-93ca-816af7f2d674" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.245287] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-90ff229f-2aa3-4ddd-93ca-816af7f2d674" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.245517] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-90ff229f-2aa3-4ddd-93ca-816af7f2d674" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.245607] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('90ff229f-2aa3-4ddd-93ca-816af7f2d674',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1345.324894] env[69232]: INFO networking_nsxv3.common.synchronization [None req-c61ae503-3909-4b53-b3c0-10e8f71a507c tempest-AttachVolumeTestJSON-1679696077 tempest-AttachVolumeTestJSON-1679696077-project-member] Enqueued Resource ID: 90ff229f-2aa3-4ddd-93ca-816af7f2d674 with Priority: HIGHEST for action security_group_rules [ 1345.325406] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 90ff229f-2aa3-4ddd-93ca-816af7f2d674 with Priority: HIGHEST for action security_group_rules [ 1345.325697] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-90ff229f-2aa3-4ddd-93ca-816af7f2d674 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.325798] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-90ff229f-2aa3-4ddd-93ca-816af7f2d674" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.397449] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.397629] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.397698] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.397908] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.422531] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.422804] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.422898] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.423050] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.423174] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.423256] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.423345] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1eb9f24d-331e-450b-9da0-82652ecba032 is going to be updated. [ 1345.451146] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.451265] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.451358] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.451532] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.451671] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.460173] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1eb9f24d-331e-450b-9da0-82652ecba032 in Status: IN_PROGRESS for 2s [ 1345.766426] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.766721] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.766721] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.766862] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.766951] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.767054] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 90ff229f-2aa3-4ddd-93ca-816af7f2d674 already deleted. [ 1345.767137] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-90ff229f-2aa3-4ddd-93ca-816af7f2d674" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.767287] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-90ff229f-2aa3-4ddd-93ca-816af7f2d674" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.767442] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-90ff229f-2aa3-4ddd-93ca-816af7f2d674" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.767523] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('90ff229f-2aa3-4ddd-93ca-816af7f2d674',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1346.289423] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1346.289423] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.289423] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1346.289616] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1346.289706] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1346.289802] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 90ff229f-2aa3-4ddd-93ca-816af7f2d674 already deleted. [ 1346.289884] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-90ff229f-2aa3-4ddd-93ca-816af7f2d674" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1347.070994] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 934b2684-b99c-4846-87df-66cbae10f2fc in Status: SUCCESS [ 1347.071441] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-934b2684-b99c-4846-87df-66cbae10f2fc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1347.071441] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-934b2684-b99c-4846-87df-66cbae10f2fc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1347.071635] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-934b2684-b99c-4846-87df-66cbae10f2fc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1347.071778] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.071896] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.071965] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1347.072130] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1347.072354] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1347.072354] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-934b2684-b99c-4846-87df-66cbae10f2fc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1347.072507] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('934b2684-b99c-4846-87df-66cbae10f2fc',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1347.470611] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1eb9f24d-331e-450b-9da0-82652ecba032 in Status: SUCCESS [ 1347.470885] env[69232]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1eb9f24d-331e-450b-9da0-82652ecba032 deletion is rescheduled due to dependency. [ 1347.470964] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1eb9f24d-331e-450b-9da0-82652ecba032" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1347.574311] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('934b2684-b99c-4846-87df-66cbae10f2fc',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1348.077030] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 934b2684-b99c-4846-87df-66cbae10f2fc: rpc.has_security_group_logging(os_id): False [ 1348.096896] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.097087] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.097174] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1348.097345] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1348.097441] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.097697] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.097812] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.097871] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1348.098048] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1348.098128] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.098216] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 934b2684-b99c-4846-87df-66cbae10f2fc is going to be updated. [ 1348.163790] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.164053] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.164053] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1348.164166] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1348.164339] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.178743] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 934b2684-b99c-4846-87df-66cbae10f2fc in Status: IN_PROGRESS for 2s [ 1350.195226] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 934b2684-b99c-4846-87df-66cbae10f2fc in Status: SUCCESS [ 1350.195642] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-934b2684-b99c-4846-87df-66cbae10f2fc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.326777] env[69232]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1350.326927] env[69232]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1351.238201] env[69232]: INFO networking_nsxv3.common.synchronization [req-81b960d2-efd1-4e8a-a9ce-f63a4119f76b req-71ee8710-eefb-456a-8dd1-176b08131c05 tempest-AttachVolumeTestJSON-1679696077 tempest-AttachVolumeTestJSON-1679696077-project-member] Enqueued Resource ID: 90ff229f-2aa3-4ddd-93ca-816af7f2d674 with Priority: HIGHEST for action security_group_members [ 1351.238201] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 90ff229f-2aa3-4ddd-93ca-816af7f2d674 with Priority: HIGHEST for action security_group_members [ 1351.238201] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-90ff229f-2aa3-4ddd-93ca-816af7f2d674 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.238201] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-90ff229f-2aa3-4ddd-93ca-816af7f2d674" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.238201] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-90ff229f-2aa3-4ddd-93ca-816af7f2d674" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.238201] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-90ff229f-2aa3-4ddd-93ca-816af7f2d674" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.239026] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.241129] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.241129] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.241129] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.241129] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1351.241129] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('90ff229f-2aa3-4ddd-93ca-816af7f2d674',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1351.540103] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock network-979 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.540103] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "network-979" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.540296] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "network-979" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.540472] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "network-979" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.540732] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.540894] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.541023] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.541243] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.541392] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1351.541600] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1351.541722] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] NeedRegenerationException {{(pid=69232) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1351.541839] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] no value, waiting for create lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1351.541954] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] value creation lock acquired {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1351.542080] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1351.542193] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Calling creation function for not-yet-present value {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1351.542332] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1351.562050] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1351.562193] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69232) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1351.562329] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Released creation lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1351.562660] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "network-979" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1351.562838] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock port-4498243f-62ed-44dc-ae33-15d33400b3ef taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.563021] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "port-4498243f-62ed-44dc-ae33-15d33400b3ef" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.563150] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "port-4498243f-62ed-44dc-ae33-15d33400b3ef" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.563484] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "port-4498243f-62ed-44dc-ae33-15d33400b3ef" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.563650] env[69232]: DEBUG networking_nsxv3.api.rpc [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4498243f-62ed-44dc-ae33-15d33400b3ef',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1351.743247] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.743459] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.743459] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.743739] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.743837] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1351.744077] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.744077] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.744294] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.744294] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.744499] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1351.744499] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 90ff229f-2aa3-4ddd-93ca-816af7f2d674 already deleted. [ 1351.744499] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-90ff229f-2aa3-4ddd-93ca-816af7f2d674" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1352.068041] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1352.068286] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1352.068423] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1352.068705] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1352.069359] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1352.069359] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Segment Port 4498243f-62ed-44dc-ae33-15d33400b3ef not found, creating... [ 1352.069359] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1352.069566] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1352.069566] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1352.069812] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1352.069973] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1352.070278] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1352.070439] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1352.070563] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1352.070777] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1352.070918] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1352.071302] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Resource: SegmentPort with ID: 4498243f-62ed-44dc-ae33-15d33400b3ef is going to be created. [ 1352.092432] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1352.092651] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1352.092784] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1352.093075] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1352.093349] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1352.094169] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "port-4498243f-62ed-44dc-ae33-15d33400b3ef" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1352.877099] env[69232]: INFO networking_nsxv3.common.synchronization [req-81b960d2-efd1-4e8a-a9ce-f63a4119f76b req-19c0a0f3-6ddf-4b9c-afd5-6a4b4e21c0a6 service nova] Enqueued Resource ID: 90ff229f-2aa3-4ddd-93ca-816af7f2d674 with Priority: HIGHEST for action security_group_rules [ 1352.877580] env[69232]: INFO networking_nsxv3.common.synchronization [req-81b960d2-efd1-4e8a-a9ce-f63a4119f76b req-19c0a0f3-6ddf-4b9c-afd5-6a4b4e21c0a6 service nova] Enqueued Resource ID: 90ff229f-2aa3-4ddd-93ca-816af7f2d674 with Priority: HIGHEST for action security_group_members [ 1352.877668] env[69232]: INFO networking_nsxv3.common.synchronization [req-81b960d2-efd1-4e8a-a9ce-f63a4119f76b req-19c0a0f3-6ddf-4b9c-afd5-6a4b4e21c0a6 service nova] Enqueued Resource ID: 4498243f-62ed-44dc-ae33-15d33400b3ef with Priority: HIGHEST for action port [ 1352.878597] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 90ff229f-2aa3-4ddd-93ca-816af7f2d674 with Priority: HIGHEST for action security_group_rules [ 1352.878696] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 90ff229f-2aa3-4ddd-93ca-816af7f2d674 with Priority: HIGHEST for action security_group_members [ 1352.878797] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4498243f-62ed-44dc-ae33-15d33400b3ef with Priority: HIGHEST for action port [ 1352.879189] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-90ff229f-2aa3-4ddd-93ca-816af7f2d674 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1352.879357] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-90ff229f-2aa3-4ddd-93ca-816af7f2d674" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1352.879454] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-90ff229f-2aa3-4ddd-93ca-816af7f2d674" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1352.879823] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-90ff229f-2aa3-4ddd-93ca-816af7f2d674" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1352.879944] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('90ff229f-2aa3-4ddd-93ca-816af7f2d674',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1352.881191] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-90ff229f-2aa3-4ddd-93ca-816af7f2d674 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1352.881349] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-90ff229f-2aa3-4ddd-93ca-816af7f2d674" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1352.881445] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-90ff229f-2aa3-4ddd-93ca-816af7f2d674" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1352.881696] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-90ff229f-2aa3-4ddd-93ca-816af7f2d674" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1352.881971] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1352.882150] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1352.882241] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1352.882441] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1352.882569] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1352.882689] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('90ff229f-2aa3-4ddd-93ca-816af7f2d674',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1352.883829] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-4498243f-62ed-44dc-ae33-15d33400b3ef taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1352.883973] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4498243f-62ed-44dc-ae33-15d33400b3ef" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1352.884103] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4498243f-62ed-44dc-ae33-15d33400b3ef" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1352.884378] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4498243f-62ed-44dc-ae33-15d33400b3ef" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1352.884479] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4498243f-62ed-44dc-ae33-15d33400b3ef',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1353.315654] env[69232]: INFO networking_nsxv3.common.synchronization [None req-a30f1afb-eaf9-407c-a40b-11c4036c4341 None None] Enqueued Resource ID: eea1a3d4-11d2-47f5-acac-9fe2107c7456 with Priority: HIGHEST for action port [ 1353.316322] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eea1a3d4-11d2-47f5-acac-9fe2107c7456 with Priority: HIGHEST for action port [ 1353.316706] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-eea1a3d4-11d2-47f5-acac-9fe2107c7456 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1353.316900] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-eea1a3d4-11d2-47f5-acac-9fe2107c7456" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1353.316982] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-eea1a3d4-11d2-47f5-acac-9fe2107c7456" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1353.317547] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-eea1a3d4-11d2-47f5-acac-9fe2107c7456" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1353.317671] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eea1a3d4-11d2-47f5-acac-9fe2107c7456',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1353.392543] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('90ff229f-2aa3-4ddd-93ca-816af7f2d674',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1353.393762] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-90ff229f-2aa3-4ddd-93ca-816af7f2d674 taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1353.393762] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-90ff229f-2aa3-4ddd-93ca-816af7f2d674" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1353.394091] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4498243f-62ed-44dc-ae33-15d33400b3ef with status ACTIVE [ 1353.394154] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1353.394344] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1353.394344] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1353.394528] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1353.394636] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1353.394773] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1353.394919] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1353.394919] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1353.395158] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1353.395158] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1353.395327] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1353.395448] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1353.395448] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1353.395658] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1353.395658] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1353.395803] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4498243f-62ed-44dc-ae33-15d33400b3ef is going to be updated. [ 1353.418478] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1353.418478] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1353.418478] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1353.418478] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1353.418478] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1353.419114] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4498243f-62ed-44dc-ae33-15d33400b3ef" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1353.823053] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port eea1a3d4-11d2-47f5-acac-9fe2107c7456 [ 1353.823352] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1353.823463] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1353.823578] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1353.823741] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1353.823830] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1353.823939] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:eea1a3d4-11d2-47f5-acac-9fe2107c7456 already deleted. [ 1353.824020] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-eea1a3d4-11d2-47f5-acac-9fe2107c7456" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1353.898159] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('90ff229f-2aa3-4ddd-93ca-816af7f2d674',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1354.401047] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.401306] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.401306] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1354.401617] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1354.401762] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1354.401762] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 90ff229f-2aa3-4ddd-93ca-816af7f2d674 is going to be created. [ 1354.429454] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.429760] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.429760] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1354.429912] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1354.430079] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1354.443019] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 90ff229f-2aa3-4ddd-93ca-816af7f2d674 in Status: UNINITIALIZED for 2s [ 1355.568601] env[69232]: INFO networking_nsxv3.common.synchronization [None req-ba43ae80-c349-450a-8050-c6c78c68098b None None] Enqueued Resource ID: 4a945837-6574-4499-a1cd-3058d49a91b4 with Priority: HIGHEST for action port [ 1355.569227] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a945837-6574-4499-a1cd-3058d49a91b4 with Priority: HIGHEST for action port [ 1355.569550] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-4a945837-6574-4499-a1cd-3058d49a91b4 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.569730] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4a945837-6574-4499-a1cd-3058d49a91b4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.569730] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4a945837-6574-4499-a1cd-3058d49a91b4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.569985] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4a945837-6574-4499-a1cd-3058d49a91b4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.570138] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4a945837-6574-4499-a1cd-3058d49a91b4',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1356.071920] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4a945837-6574-4499-a1cd-3058d49a91b4 [ 1356.072244] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1356.072404] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1356.072499] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1356.072771] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1356.072889] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1356.072998] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4a945837-6574-4499-a1cd-3058d49a91b4 already deleted. [ 1356.073100] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4a945837-6574-4499-a1cd-3058d49a91b4" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1356.453839] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 90ff229f-2aa3-4ddd-93ca-816af7f2d674 in Status: SUCCESS [ 1356.454070] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-90ff229f-2aa3-4ddd-93ca-816af7f2d674" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1356.454247] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-90ff229f-2aa3-4ddd-93ca-816af7f2d674" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1356.454456] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-90ff229f-2aa3-4ddd-93ca-816af7f2d674" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1356.454668] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1356.454789] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1356.454853] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1356.455026] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1356.455094] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1356.455352] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-90ff229f-2aa3-4ddd-93ca-816af7f2d674" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1356.455441] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('90ff229f-2aa3-4ddd-93ca-816af7f2d674',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1356.958427] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('90ff229f-2aa3-4ddd-93ca-816af7f2d674',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1357.460502] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 90ff229f-2aa3-4ddd-93ca-816af7f2d674: rpc.has_security_group_logging(os_id): False [ 1357.482921] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1357.483187] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1357.483286] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1357.483574] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1357.483712] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1357.484015] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1357.484238] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1357.484312] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1357.484582] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1357.484727] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1357.484871] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 90ff229f-2aa3-4ddd-93ca-816af7f2d674 is going to be created. [ 1357.549170] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1357.549421] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1357.549475] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1357.549756] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1357.549966] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1357.572918] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 90ff229f-2aa3-4ddd-93ca-816af7f2d674 in Status: IN_PROGRESS for 2s [ 1359.150468] env[69232]: INFO networking_nsxv3.common.synchronization [req-722e5247-0096-4eb0-8705-486c1421acbc req-98955a52-8e1b-46eb-b742-5cd030c1935c tempest-ServerMetadataNegativeTestJSON-1940622910 tempest-ServerMetadataNegativeTestJSON-1940622910-project-member] Enqueued Resource ID: 25e9485b-f230-47ac-a1dc-51f21aedb10a with Priority: HIGHEST for action security_group_members [ 1359.151277] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25e9485b-f230-47ac-a1dc-51f21aedb10a with Priority: HIGHEST for action security_group_members [ 1359.151462] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-25e9485b-f230-47ac-a1dc-51f21aedb10a taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1359.151610] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-25e9485b-f230-47ac-a1dc-51f21aedb10a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1359.151692] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-25e9485b-f230-47ac-a1dc-51f21aedb10a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1359.151999] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-25e9485b-f230-47ac-a1dc-51f21aedb10a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1359.152203] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1359.152302] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1359.152372] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1359.152529] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1359.152658] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1359.152812] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('25e9485b-f230-47ac-a1dc-51f21aedb10a',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1359.391621] env[69232]: INFO networking_nsxv3.common.synchronization [req-e56d1d3c-ac57-4d66-be4f-cbe75eec324d req-6a41acbf-63f3-4dc5-94b2-71bf7f96da19 tempest-ServerActionsTestOtherB-650813181 tempest-ServerActionsTestOtherB-650813181-project-member] Enqueued Resource ID: 934b2684-b99c-4846-87df-66cbae10f2fc with Priority: HIGHEST for action security_group_members [ 1359.392147] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 934b2684-b99c-4846-87df-66cbae10f2fc with Priority: HIGHEST for action security_group_members [ 1359.392442] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-934b2684-b99c-4846-87df-66cbae10f2fc taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1359.392566] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-934b2684-b99c-4846-87df-66cbae10f2fc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1359.392840] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-934b2684-b99c-4846-87df-66cbae10f2fc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1359.392958] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-934b2684-b99c-4846-87df-66cbae10f2fc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1359.393191] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1359.393279] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1359.393351] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1359.393462] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1359.393547] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1359.393637] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('934b2684-b99c-4846-87df-66cbae10f2fc',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1359.476558] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock network-990 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1359.476812] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "network-990" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1359.476954] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "network-990" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1359.477324] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "network-990" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1359.477584] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1359.477788] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1359.477921] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1359.478161] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1359.478312] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1359.478531] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1359.478653] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] NeedRegenerationException {{(pid=69232) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1359.478769] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] no value, waiting for create lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1359.478886] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] value creation lock acquired {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1359.479008] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] No value present for key: 'zone-id' {{(pid=69232) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1359.479135] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Calling creation function for not-yet-present value {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1359.479272] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1359.498081] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1359.498499] env[69232]: DEBUG dogpile.cache.region [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69232) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1359.498499] env[69232]: DEBUG dogpile.lock [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Released creation lock {{(pid=69232) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1359.498632] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "network-990" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1359.498907] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock port-bf2d5efb-c1f1-4e16-b04f-1d5009d5d677 taken with stack trace [, , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1359.499098] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "port-bf2d5efb-c1f1-4e16-b04f-1d5009d5d677" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1359.499225] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "port-bf2d5efb-c1f1-4e16-b04f-1d5009d5d677" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1359.499651] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "port-bf2d5efb-c1f1-4e16-b04f-1d5009d5d677" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1359.499801] env[69232]: DEBUG networking_nsxv3.api.rpc [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bf2d5efb-c1f1-4e16-b04f-1d5009d5d677',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1359.584602] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 90ff229f-2aa3-4ddd-93ca-816af7f2d674 in Status: SUCCESS [ 1359.584791] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-90ff229f-2aa3-4ddd-93ca-816af7f2d674" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1359.655777] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1359.655948] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1359.656017] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1359.656222] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1359.656314] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1359.656508] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1359.656608] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1359.656663] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1359.656867] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1359.656952] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1359.657064] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 25e9485b-f230-47ac-a1dc-51f21aedb10a already deleted. [ 1359.657188] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-25e9485b-f230-47ac-a1dc-51f21aedb10a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1359.895786] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1359.895786] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1359.896091] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1359.896133] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1359.896203] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1359.896392] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1359.896491] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1359.896553] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1359.896906] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1359.897035] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1359.897140] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 934b2684-b99c-4846-87df-66cbae10f2fc is going to be updated. [ 1359.923036] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1359.923036] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1359.923036] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1359.923036] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1359.923273] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1359.931332] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 934b2684-b99c-4846-87df-66cbae10f2fc in Status: IN_PROGRESS for 2s [ 1360.006063] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.006063] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1360.006063] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1360.006449] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1360.006487] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1360.007408] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Segment Port bf2d5efb-c1f1-4e16-b04f-1d5009d5d677 not found, creating... [ 1360.007408] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.007408] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1360.007408] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1360.007750] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1360.007750] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1360.007888] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.008405] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1360.008622] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1360.008967] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1360.009154] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1360.009374] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Resource: SegmentPort with ID: bf2d5efb-c1f1-4e16-b04f-1d5009d5d677 is going to be created. [ 1360.029563] env[69232]: DEBUG networking_nsxv3.common.locking [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.029563] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1360.029784] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1360.029947] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1360.030983] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1360.030983] env[69232]: DEBUG oslo_concurrency.lockutils [None req-890e2b25-a949-49cc-926e-115a5f31e13e None None] Releasing lock "port-bf2d5efb-c1f1-4e16-b04f-1d5009d5d677" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1360.719715] env[69232]: INFO networking_nsxv3.common.synchronization [req-722e5247-0096-4eb0-8705-486c1421acbc req-2fb2f6eb-3009-4e26-ab71-dc0ef233776c service nova] Enqueued Resource ID: 25e9485b-f230-47ac-a1dc-51f21aedb10a with Priority: HIGHEST for action security_group_rules [ 1360.720056] env[69232]: INFO networking_nsxv3.common.synchronization [req-722e5247-0096-4eb0-8705-486c1421acbc req-2fb2f6eb-3009-4e26-ab71-dc0ef233776c service nova] Enqueued Resource ID: 25e9485b-f230-47ac-a1dc-51f21aedb10a with Priority: HIGHEST for action security_group_members [ 1360.720293] env[69232]: INFO networking_nsxv3.common.synchronization [req-722e5247-0096-4eb0-8705-486c1421acbc req-2fb2f6eb-3009-4e26-ab71-dc0ef233776c service nova] Enqueued Resource ID: bf2d5efb-c1f1-4e16-b04f-1d5009d5d677 with Priority: HIGHEST for action port [ 1360.720922] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25e9485b-f230-47ac-a1dc-51f21aedb10a with Priority: HIGHEST for action security_group_rules [ 1360.721151] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25e9485b-f230-47ac-a1dc-51f21aedb10a with Priority: HIGHEST for action security_group_members [ 1360.721403] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf2d5efb-c1f1-4e16-b04f-1d5009d5d677 with Priority: HIGHEST for action port [ 1360.721705] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock rules-25e9485b-f230-47ac-a1dc-51f21aedb10a taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.721889] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-25e9485b-f230-47ac-a1dc-51f21aedb10a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1360.721982] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-25e9485b-f230-47ac-a1dc-51f21aedb10a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1360.722345] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-25e9485b-f230-47ac-a1dc-51f21aedb10a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1360.722466] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('25e9485b-f230-47ac-a1dc-51f21aedb10a',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1360.723628] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-25e9485b-f230-47ac-a1dc-51f21aedb10a taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.723795] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-25e9485b-f230-47ac-a1dc-51f21aedb10a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1360.723899] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-25e9485b-f230-47ac-a1dc-51f21aedb10a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1360.724171] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-25e9485b-f230-47ac-a1dc-51f21aedb10a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1360.724406] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.724557] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1360.724731] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1360.724959] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1360.725115] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1360.725257] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('25e9485b-f230-47ac-a1dc-51f21aedb10a',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1360.726316] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock port-bf2d5efb-c1f1-4e16-b04f-1d5009d5d677 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.726515] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bf2d5efb-c1f1-4e16-b04f-1d5009d5d677" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1360.726579] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bf2d5efb-c1f1-4e16-b04f-1d5009d5d677" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1360.726901] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bf2d5efb-c1f1-4e16-b04f-1d5009d5d677" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1360.727656] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bf2d5efb-c1f1-4e16-b04f-1d5009d5d677',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1361.229163] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('25e9485b-f230-47ac-a1dc-51f21aedb10a',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1361.230532] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-25e9485b-f230-47ac-a1dc-51f21aedb10a taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.230532] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-25e9485b-f230-47ac-a1dc-51f21aedb10a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.232032] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bf2d5efb-c1f1-4e16-b04f-1d5009d5d677 with status ACTIVE [ 1361.232278] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.232490] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.232543] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.232766] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.232870] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1361.233071] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.233171] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.233233] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.233397] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.233477] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1361.233655] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.233749] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.233811] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.233954] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.234041] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1361.234128] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bf2d5efb-c1f1-4e16-b04f-1d5009d5d677 is going to be updated. [ 1361.259893] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.260079] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.260149] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.260357] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.260490] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1361.260648] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bf2d5efb-c1f1-4e16-b04f-1d5009d5d677" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1361.731841] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('25e9485b-f230-47ac-a1dc-51f21aedb10a',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1361.940765] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 934b2684-b99c-4846-87df-66cbae10f2fc in Status: SUCCESS [ 1361.940988] env[69232]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 934b2684-b99c-4846-87df-66cbae10f2fc deletion is rescheduled due to dependency. [ 1361.941122] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-934b2684-b99c-4846-87df-66cbae10f2fc" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.235884] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.235884] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.235884] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.235884] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1362.235884] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.235884] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 25e9485b-f230-47ac-a1dc-51f21aedb10a is going to be created. [ 1362.262992] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.263188] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.263188] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.263403] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1362.264331] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.273165] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 25e9485b-f230-47ac-a1dc-51f21aedb10a in Status: UNINITIALIZED for 2s [ 1364.284256] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 25e9485b-f230-47ac-a1dc-51f21aedb10a in Status: SUCCESS [ 1364.284653] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-25e9485b-f230-47ac-a1dc-51f21aedb10a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1364.284653] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-25e9485b-f230-47ac-a1dc-51f21aedb10a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1364.284851] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-25e9485b-f230-47ac-a1dc-51f21aedb10a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1364.285053] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1364.285175] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1364.285241] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1364.285402] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1364.285482] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1364.285568] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-25e9485b-f230-47ac-a1dc-51f21aedb10a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1364.285657] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('25e9485b-f230-47ac-a1dc-51f21aedb10a',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1364.788472] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-25e9485b-f230-47ac-a1dc-51f21aedb10a taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1364.788756] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-25e9485b-f230-47ac-a1dc-51f21aedb10a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1364.788756] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-25e9485b-f230-47ac-a1dc-51f21aedb10a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1364.788999] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-25e9485b-f230-47ac-a1dc-51f21aedb10a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1364.789298] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1364.789451] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1364.789451] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1364.789582] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1364.789672] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1364.789762] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-25e9485b-f230-47ac-a1dc-51f21aedb10a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1364.789914] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-25e9485b-f230-47ac-a1dc-51f21aedb10a taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1364.790046] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-25e9485b-f230-47ac-a1dc-51f21aedb10a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1364.790145] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-25e9485b-f230-47ac-a1dc-51f21aedb10a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1364.790228] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-25e9485b-f230-47ac-a1dc-51f21aedb10a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1364.790365] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1364.790456] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1364.790514] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1364.790652] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1364.790727] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1364.790806] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-25e9485b-f230-47ac-a1dc-51f21aedb10a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1364.790896] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('25e9485b-f230-47ac-a1dc-51f21aedb10a',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1365.293879] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 25e9485b-f230-47ac-a1dc-51f21aedb10a: rpc.has_security_group_logging(os_id): False [ 1365.313904] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1365.314157] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1365.314157] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1365.314328] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1365.314417] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1365.314602] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1365.314701] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1365.314770] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1365.314911] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1365.314988] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1365.315204] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1365.315328] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1365.315375] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1365.315495] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1365.315567] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1365.315745] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1365.315838] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1365.315899] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1365.316051] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1365.316127] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1365.316211] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 25e9485b-f230-47ac-a1dc-51f21aedb10a is going to be created. [ 1365.371790] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1365.372050] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1365.372050] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1365.372217] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1365.372396] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1365.383403] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 25e9485b-f230-47ac-a1dc-51f21aedb10a in Status: IN_PROGRESS for 2s [ 1365.722629] env[69232]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1365.722841] env[69232]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1367.398140] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 25e9485b-f230-47ac-a1dc-51f21aedb10a in Status: SUCCESS [ 1367.398518] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-25e9485b-f230-47ac-a1dc-51f21aedb10a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1370.723663] env[69232]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1370.724055] env[69232]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1372.009288] env[69232]: INFO networking_nsxv3.common.synchronization [req-30e94a88-e19f-42d3-946f-7b9de5b1dfbf req-02a17401-2dbd-4b4c-8487-f43057d799b4 tempest-ServerMetadataNegativeTestJSON-1940622910 tempest-ServerMetadataNegativeTestJSON-1940622910-project-member] Enqueued Resource ID: 25e9485b-f230-47ac-a1dc-51f21aedb10a with Priority: HIGHEST for action security_group_members [ 1372.009585] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25e9485b-f230-47ac-a1dc-51f21aedb10a with Priority: HIGHEST for action security_group_members [ 1372.009798] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-25e9485b-f230-47ac-a1dc-51f21aedb10a taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1372.009915] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-25e9485b-f230-47ac-a1dc-51f21aedb10a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1372.009978] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-25e9485b-f230-47ac-a1dc-51f21aedb10a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1372.010212] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-25e9485b-f230-47ac-a1dc-51f21aedb10a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1372.010974] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1372.010974] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1372.010974] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1372.010974] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1372.010974] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1372.010974] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('25e9485b-f230-47ac-a1dc-51f21aedb10a',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1372.512917] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1372.513091] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1372.513167] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1372.513387] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1372.513480] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1372.513684] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1372.513781] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1372.513844] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1372.513994] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1372.514080] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1372.514166] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 25e9485b-f230-47ac-a1dc-51f21aedb10a is going to be updated. [ 1372.543732] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1372.543732] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1372.543732] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1372.544077] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1372.544077] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1372.553397] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 25e9485b-f230-47ac-a1dc-51f21aedb10a in Status: IN_PROGRESS for 2s [ 1374.564544] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 25e9485b-f230-47ac-a1dc-51f21aedb10a in Status: SUCCESS [ 1374.564977] env[69232]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 25e9485b-f230-47ac-a1dc-51f21aedb10a deletion is rescheduled due to dependency. [ 1374.564977] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-25e9485b-f230-47ac-a1dc-51f21aedb10a" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1377.010982] env[69232]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1377.011335] env[69232]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1382.011891] env[69232]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1382.012302] env[69232]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1387.012735] env[69232]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1387.013107] env[69232]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1392.014236] env[69232]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1392.014695] env[69232]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1397.015877] env[69232]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1397.016296] env[69232]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1402.017528] env[69232]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1402.017992] env[69232]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1407.019194] env[69232]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1407.019565] env[69232]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1412.020562] env[69232]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1412.021057] env[69232]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1417.021774] env[69232]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1417.022158] env[69232]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1422.022496] env[69232]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1422.022835] env[69232]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1427.023594] env[69232]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1427.023921] env[69232]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1430.863699] env[69232]: INFO networking_nsxv3.common.synchronization [req-c00641e9-6d61-4d33-9d46-6addc162529b req-704d44a5-c32f-4046-9932-9a9073db55a3 tempest-AttachVolumeTestJSON-1679696077 tempest-AttachVolumeTestJSON-1679696077-project-member] Enqueued Resource ID: 90ff229f-2aa3-4ddd-93ca-816af7f2d674 with Priority: HIGHEST for action security_group_members [ 1430.864058] env[69232]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 90ff229f-2aa3-4ddd-93ca-816af7f2d674 with Priority: HIGHEST for action security_group_members [ 1430.864402] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock member-90ff229f-2aa3-4ddd-93ca-816af7f2d674 taken with stack trace [, , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1430.864529] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-90ff229f-2aa3-4ddd-93ca-816af7f2d674" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1430.864597] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-90ff229f-2aa3-4ddd-93ca-816af7f2d674" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1430.864921] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-90ff229f-2aa3-4ddd-93ca-816af7f2d674" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1430.865105] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1430.865231] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1430.865284] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1430.865454] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1430.865564] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1430.865665] env[69232]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('90ff229f-2aa3-4ddd-93ca-816af7f2d674',) {} {{(pid=69232) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1431.367795] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1431.367993] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1431.368086] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1431.368322] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1431.368420] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1431.368643] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1431.368734] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1431.368799] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1431.368941] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1431.369026] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1431.369111] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 90ff229f-2aa3-4ddd-93ca-816af7f2d674 is going to be updated. [ 1431.406957] env[69232]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69232) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1431.407233] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1431.407233] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1431.407394] env[69232]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1431.407565] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1431.419161] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 90ff229f-2aa3-4ddd-93ca-816af7f2d674 in Status: IN_PROGRESS for 2s [ 1433.430470] env[69232]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 90ff229f-2aa3-4ddd-93ca-816af7f2d674 in Status: SUCCESS [ 1433.430823] env[69232]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 90ff229f-2aa3-4ddd-93ca-816af7f2d674 deletion is rescheduled due to dependency. [ 1433.430823] env[69232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-90ff229f-2aa3-4ddd-93ca-816af7f2d674" {{(pid=69232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1435.865172] env[69232]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1435.865564] env[69232]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1440.866432] env[69232]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1440.866755] env[69232]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1445.867906] env[69232]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1445.868124] env[69232]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1450.868716] env[69232]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1450.869172] env[69232]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1455.870683] env[69232]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1455.870683] env[69232]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1460.872027] env[69232]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1460.872369] env[69232]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1465.873764] env[69232]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1465.874139] env[69232]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1470.875126] env[69232]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1470.875607] env[69232]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0